-- Logs begin at Wed 2021-05-26 14:03:45 UTC, end at Wed 2021-05-26 15:02:17 UTC. -- May 26 14:34:34.069974 dv-cinder-774594-6-iscsi systemd[1]: Started Devstack devstack@q-svc.service. May 26 14:34:35.209535 dv-cinder-774594-6-iscsi neutron-server[98337]: Beware of the coming changes in the project packaging May 26 14:34:35.211253 dv-cinder-774594-6-iscsi neutron-server[98337]: https://github.com/svinota/pyroute2/discussions/786 May 26 14:34:36.667197 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.common.config [-] Logging enabled! May 26 14:34:36.667865 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240 May 26 14:34:36.667975 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98337) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 26 14:34:36.671137 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.common.config [-] Logging enabled! May 26 14:34:36.671394 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240 May 26 14:34:36.671704 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98337) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 26 14:34:36.672643 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:34:36.672873 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:34:36.673243 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:34:36.673492 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:34:36.673713 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:34:36.674032 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.674332 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.674645 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.674873 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.675149 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.675438 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.675720 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.676006 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.676304 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.676588 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.676864 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.677138 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.677363 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.677645 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] config_source = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.677931 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.678215 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.678463 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] debug = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.678776 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.679202 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.679624 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.679908 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.680200 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.680485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.680752 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.681028 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.681319 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.681646 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] host = dv-cinder-774594-6-iscsi {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.681924 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.682213 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.682519 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.682836 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.683214 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.683496 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.683778 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.684105 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] log_dir = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.684380 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] log_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.684656 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.684943 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.685268 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.685666 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.685899 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.686148 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.686487 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.686777 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.687057 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.687339 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.687612 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.687893 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.688170 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.688444 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.688732 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.689014 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.689298 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.689582 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.689861 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.690138 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.690442 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.690735 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.691010 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.691282 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.691556 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.691848 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.692126 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.692404 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.692703 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.692991 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.693269 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.693550 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.693828 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.694114 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.694431 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.694734 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] use_journal = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.695007 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] use_json = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.695273 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.695543 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.695825 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.696099 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.696373 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.696643 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.696914 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.697195 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:36.697503 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.697793 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.698098 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.698413 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.698712 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.698998 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.699286 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.699576 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.699897 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.700167 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.700476 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.700778 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.701067 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.701347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.701642 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.701941 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.702241 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.702564 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.702839 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.703114 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.703390 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.703668 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.703961 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.704262 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.704553 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.704822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.705111 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.705399 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.705676 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.705950 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.706231 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.706691 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.706969 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.707245 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.707528 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.707804 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.708075 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.708348 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.708632 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.708925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.709207 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.709491 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.709762 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.710059 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.710362 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.710657 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.710939 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.711211 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.711491 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.711774 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.712050 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.712322 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.712607 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.712877 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.713159 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.713433 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.713707 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.713978 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.714250 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.714551 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.715175 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.715446 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.715722 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.715994 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.716264 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.716544 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.716818 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.717091 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.717486 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.717679 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.717959 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.718239 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.718647 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.718933 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.719213 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.719493 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.719776 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.720056 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.720334 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.720623 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.720909 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.721199 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.721482 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.721761 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.722058 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.722357 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.722650 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.722933 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.723214 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.723505 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.723789 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.724086 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.724376 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.724668 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.724962 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.725257 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.725539 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.725907 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.726186 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:36.726430 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:34:36.726687 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=98337) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} May 26 14:34:37.071524 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=98337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:34:37.071789 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=98337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:34:37.072074 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=98337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:34:37.072566 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [-] Loading core plugin: ml2 May 26 14:34:37.463533 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.463757 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.463982 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.465547 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.465819 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.466084 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.501018 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.501289 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.501552 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.514527 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.514844 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.515105 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.544486 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.544764 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.545032 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.581178 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.581451 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.581715 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.810322 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.810972 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.810972 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.811139 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.811871 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.934845 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.935144 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.935436 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.935714 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.935985 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.936299 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.936559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.936821 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.937076 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.937361 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.937620 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.937884 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.938134 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.938417 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.938699 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.938970 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.940321 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.940624 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.940900 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.941198 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.941562 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.941830 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.942087 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.942403 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.942647 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.942900 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.943288 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=98337) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 26 14:34:37.943528 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=98337) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 26 14:34:37.943764 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=98337) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 26 14:34:37.943998 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=98337) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 26 14:34:37.944231 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=98337) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 26 14:34:37.944560 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=98337) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 26 14:34:37.944936 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] May 26 14:34:37.948073 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] May 26 14:34:37.952009 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete May 26 14:34:37.955788 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(1100, 1149)])]) May 26 14:34:37.957443 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] May 26 14:34:37.957889 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) May 26 14:34:37.958222 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] May 26 14:34:37.958636 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] May 26 14:34:37.961619 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] May 26 14:34:37.961871 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] May 26 14:34:37.962217 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] May 26 14:34:37.989588 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] May 26 14:34:37.990032 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.990320 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=98337) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} May 26 14:34:37.990722 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.992098 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=98337) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} May 26 14:34:37.992376 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] May 26 14:34:37.992640 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] May 26 14:34:37.995890 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:37.996176 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.066543 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' May 26 14:34:38.066703 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete May 26 14:34:38.066942 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' May 26 14:34:38.067317 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] May 26 14:34:38.098884 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_db.sqlalchemy.engines [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:34:38.435988 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Initializing driver for type 'gre' May 26 14:34:38.436443 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] gre ID ranges: [(1, 1000)] May 26 14:34:38.492044 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Initializing driver for type 'local' May 26 14:34:38.492442 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Initializing driver for type 'vlan' May 26 14:34:38.504381 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] VlanTypeDriver initialization complete May 26 14:34:38.504883 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Initializing driver for type 'vxlan' May 26 14:34:38.505405 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] vxlan ID ranges: [(1, 1000)] May 26 14:34:38.558252 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Initializing extension driver 'port_security' May 26 14:34:38.558682 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.extensions.port_security [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] PortSecurityExtensionDriver initialization complete May 26 14:34:38.559023 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Initializing mechanism driver 'openvswitch' May 26 14:34:38.559360 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Initializing mechanism driver 'hyperv' May 26 14:34:38.565988 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.plugins.ml2.plugin [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=98337) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:34:38.566793 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > port after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.567168 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > port after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.567518 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > port after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.567902 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > subnet after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.568252 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > subnet after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.568597 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > subnet after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.568979 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > network after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.569329 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > network after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.569673 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > network after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.570051 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > security_group after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.570429 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > security_group after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.570770 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > security_group after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.571145 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.571486 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.571823 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.572196 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > address_group after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.572540 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > address_group after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.572877 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > address_group after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.573210 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] ML2 OVO RPC backend initialized. {{(pid=98337) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}} May 26 14:34:38.573920 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router_interface after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.574274 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.574713 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > network before_response 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.575058 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > networks before_response 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.575404 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > port before_response 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.575744 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > ports before_response 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.576085 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > subnet before_response 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.576422 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > subnets before_response 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.576763 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > network after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.577179 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > network after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.577437 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > network after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.577768 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > port after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.578105 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > port after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.578469 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > port after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.578807 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > subnet after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.579155 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > subnet after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.579504 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > subnet after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.580090 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.plugin [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Modular L2 Plugin initialization complete May 26 14:34:38.580420 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading services supported by the core plugin {{(pid=98337) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} May 26 14:34:38.580747 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.plugins.ml2.managers [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Got port-security extension from driver 'port_security' May 26 14:34:38.581215 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.extensions.vlantransparent [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Disabled vlantransparent extension. May 26 14:34:38.581702 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=98337) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} May 26 14:34:38.582017 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading Plugin: router May 26 14:34:38.620171 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router_interface before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.620566 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router after_create 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.620935 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router before_create 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.621298 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router_interface before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.621666 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.622017 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router after_delete 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.622362 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > floatingip after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.622750 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router after_create 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.623091 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router after_update 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.623437 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router after_update 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.623767 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.624134 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router after_update 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.624520 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_update 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.624890 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: port after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.625228 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: port after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.625561 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: subnet after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.625899 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.626242 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > port precommit_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.626615 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_create 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.626960 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: port before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.627298 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.627651 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router after_update 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.627988 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_delete 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.628335 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_create 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.628695 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router_interface after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.629020 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_update 55549900 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.629388 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > network after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.630250 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Tracking information for resource: router configured {{(pid=98337) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 26 14:34:38.630672 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Tracking information for resource: floatingip configured {{(pid=98337) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 26 14:34:38.635950 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.db.l3_agentschedulers_db [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. May 26 14:34:38.636529 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: port after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.636894 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: port after_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.637240 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: port after_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.637592 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: port after_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.638430 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router before_create 55550100 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.638797 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_delete 55550100 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.639156 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_create 55550100 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.639509 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > router precommit_update 55550100 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.644041 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.services.provider_configuration [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service providers = [] {{(pid=98337) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} May 26 14:34:38.644400 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.db.servicetype_db [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=98337) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} May 26 14:34:38.647360 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.services.service_base [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=98337) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 26 14:34:38.647758 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.services.service_base [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=98337) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 26 14:34:38.648100 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.services.service_base [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=98337) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 26 14:34:38.648976 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.services.service_base [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=98337) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 26 14:34:38.649348 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.services.service_base [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Default provider is not specified for service type L3_ROUTER_NAT May 26 14:34:38.649893 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=98337) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 26 14:34:38.650218 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin May 26 14:34:38.660747 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Successfully loaded METERING plugin. Description: METERING {{(pid=98337) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 26 14:34:38.661082 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading Plugin: auto_allocate May 26 14:34:38.667143 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: network precommit_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.667514 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: network precommit_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.668029 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=98337) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 26 14:34:38.668340 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading Plugin: tag May 26 14:34:38.675134 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=98337) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 26 14:34:38.675464 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading Plugin: timestamp May 26 14:34:38.679292 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=98337) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 26 14:34:38.679616 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading Plugin: network_ip_availability May 26 14:34:38.684844 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.685214 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.685569 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.686376 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=98337) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 26 14:34:38.686639 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading Plugin: flavors May 26 14:34:38.691637 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=98337) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 26 14:34:38.691967 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading Plugin: revisions May 26 14:34:38.696305 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=98337) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 26 14:34:38.696694 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_concurrency.lockutils [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.625s {{(pid=98337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:34:38.697433 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=98337) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} May 26 14:34:38.697771 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Initializing extension manager. May 26 14:34:38.698271 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: __init__.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.698639 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: __pycache__ {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.698972 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.699302 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: address_group.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.700066 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.700631 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: address-group May 26 14:34:38.700952 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: address_scope.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.701664 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.702172 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: address-scope May 26 14:34:38.702523 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: admin_state_down_before_update.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.703443 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.703954 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: router-admin-state-down-before-update May 26 14:34:38.704261 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: agent.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.704953 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.705461 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: agent May 26 14:34:38.705778 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: agent_resources_synced.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.706721 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.707227 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: agent-resources-synced May 26 14:34:38.707547 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: allowedaddresspairs.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.709339 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.709853 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: allowed-address-pairs May 26 14:34:38.710198 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: auto_allocated_topology.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.711305 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.711819 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: auto-allocated-topology May 26 14:34:38.712136 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: availability_zone.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.712822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.713355 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: availability_zone May 26 14:34:38.713673 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: availability_zone_filter.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.714606 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.715426 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: availability_zone_filter May 26 14:34:38.715746 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: data_plane_status.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.716657 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.717154 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension data-plane-status not supported by any of loaded plugins May 26 14:34:38.717471 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: default_subnetpools.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.718403 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.718904 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: default-subnetpools May 26 14:34:38.719220 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: dhcpagentscheduler.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.720027 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.720531 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: dhcp_agent_scheduler May 26 14:34:38.720846 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: dns.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.721756 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.722260 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension dns-integration not supported by any of loaded plugins May 26 14:34:38.722607 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: dns_domain_ports.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.723506 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.724010 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension dns-domain-ports not supported by any of loaded plugins May 26 14:34:38.724331 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: dvr.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.725009 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.725524 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: dvr May 26 14:34:38.725870 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: empty_string_filtering.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.726799 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.727311 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: empty-string-filtering May 26 14:34:38.727628 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.728532 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.729029 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins May 26 14:34:38.729345 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.730238 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.730771 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins May 26 14:34:38.731088 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: external_net.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.731982 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.732490 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: external-net May 26 14:34:38.732802 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: extra_dhcp_opt.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.733691 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.734195 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: extra_dhcp_opt May 26 14:34:38.734541 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: extraroute.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.735429 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.735930 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: extraroute May 26 14:34:38.736246 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: extraroute_atomic.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.737268 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.737777 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: extraroute-atomic May 26 14:34:38.738096 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: filter_validation.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.738801 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.739296 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: filter-validation May 26 14:34:38.739671 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: fip_pf_description.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.740717 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.741248 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins May 26 14:34:38.741567 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: fip_port_details.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.742511 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.743017 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: fip-port-details May 26 14:34:38.743336 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: flavors.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.744593 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.745109 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: flavors May 26 14:34:38.745435 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.747228 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.747780 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins May 26 14:34:38.748103 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: floatingip_pools.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.748796 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.749305 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: floatingip-pools May 26 14:34:38.749628 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: ip_allocation.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.750590 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.751095 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension ip_allocation not supported by any of loaded plugins May 26 14:34:38.751414 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: ip_substring_port_filtering.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.752318 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.752827 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: ip-substring-filtering May 26 14:34:38.753144 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: l2_adjacency.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.754058 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.754598 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension l2_adjacency not supported by any of loaded plugins May 26 14:34:38.754912 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: l3.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.755893 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.756407 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: router May 26 14:34:38.756728 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: l3_conntrack_helper.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.759071 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.759603 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension l3-conntrack-helper not supported by any of loaded plugins May 26 14:34:38.759928 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: l3_ext_gw_mode.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.760857 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.761374 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: ext-gw-mode May 26 14:34:38.761700 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: l3_ext_ha_mode.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.762642 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.763159 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: l3-ha May 26 14:34:38.763480 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: l3_flavors.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.764386 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.764891 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: l3-flavors May 26 14:34:38.765214 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.766126 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.766662 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: l3-port-ip-change-not-allowed May 26 14:34:38.766983 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: l3agentscheduler.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.768035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.768543 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: l3_agent_scheduler May 26 14:34:38.768870 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: logging.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.770400 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.770916 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension logging not supported by any of loaded plugins May 26 14:34:38.771241 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: metering.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.771976 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.772583 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: metering May 26 14:34:38.772905 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.773989 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.774528 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: metering_source_and_destination_fields May 26 14:34:38.774847 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: multiprovidernet.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.775888 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.776394 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: multi-provider May 26 14:34:38.776711 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: netmtu.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.777613 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.778116 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: net-mtu May 26 14:34:38.778470 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: netmtu_writable.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.779378 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.779879 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: net-mtu-writable May 26 14:34:38.780196 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: network_availability_zone.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.780856 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.781355 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: network_availability_zone May 26 14:34:38.781674 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: network_ip_availability.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.782777 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.783284 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: network-ip-availability May 26 14:34:38.783602 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: network_segment_range.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.784360 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.784863 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension network-segment-range not supported by any of loaded plugins May 26 14:34:38.785168 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: pagination.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.786150 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.786504 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: pagination May 26 14:34:38.786820 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: port_device_profile.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.787718 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.788286 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: port-device-profile May 26 14:34:38.788606 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: port_mac_address_regenerate.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.789520 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.790027 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: port-mac-address-regenerate May 26 14:34:38.790352 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: port_numa_affinity_policy.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.791262 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.791766 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: port-numa-affinity-policy May 26 14:34:38.792081 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: port_resource_request.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.792989 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.793488 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension port-resource-request not supported by any of loaded plugins May 26 14:34:38.793805 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: portbindings.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.794758 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.795279 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: binding May 26 14:34:38.795597 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: portbindings_extended.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.796875 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.797386 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: binding-extended May 26 14:34:38.797715 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: portsecurity.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.798647 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.799156 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: port-security May 26 14:34:38.799475 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: project_id.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.800441 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.800770 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: project-id May 26 14:34:38.801089 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: providernet.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.801999 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.802530 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: provider May 26 14:34:38.802845 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.806513 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.807033 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos not supported by any of loaded plugins May 26 14:34:38.807364 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos_bw_limit_direction.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.808599 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.809116 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos-bw-limit-direction not supported by any of loaded plugins May 26 14:34:38.809442 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.810373 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.810912 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins May 26 14:34:38.811205 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos_default.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.812115 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.812621 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos-default not supported by any of loaded plugins May 26 14:34:38.812945 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos_fip.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.813592 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.814117 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos-fip not supported by any of loaded plugins May 26 14:34:38.814481 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos_gateway_ip.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.815383 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.815905 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos-gateway-ip not supported by any of loaded plugins May 26 14:34:38.816222 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos_port_network_policy.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.817127 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.817638 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos-port-network-policy not supported by any of loaded plugins May 26 14:34:38.817954 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos_rule_type_details.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.818899 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.819489 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos-rule-type-details not supported by any of loaded plugins May 26 14:34:38.819810 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: qos_rules_alias.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.820868 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.821353 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension qos-rules-alias not supported by any of loaded plugins May 26 14:34:38.821659 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: quotasv2.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.822765 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.823118 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: quotas May 26 14:34:38.823437 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: quotasv2_detail.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.825124 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.825466 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: quota_details May 26 14:34:38.825797 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: rbac.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.826880 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.827479 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: rbac-policies May 26 14:34:38.827808 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: rbac_address_group.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.828801 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.829413 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: rbac-address-group May 26 14:34:38.829773 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: rbac_address_scope.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.830840 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.831369 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: rbac-address-scope May 26 14:34:38.831690 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: rbac_security_groups.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.832621 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.833133 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: rbac-security-groups May 26 14:34:38.833453 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: rbac_subnetpool.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.834386 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.834951 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: rbac-subnetpool May 26 14:34:38.835269 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: revisionifmatch.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.836144 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.836690 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: revision-if-match May 26 14:34:38.837006 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: revisions.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.838128 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.838673 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: standard-attr-revisions May 26 14:34:38.838997 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: router_availability_zone.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.839662 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.840520 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: router_availability_zone May 26 14:34:38.840843 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: routerservicetype.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.841766 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.842270 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension router-service-type not supported by any of loaded plugins May 26 14:34:38.842632 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.843550 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.844074 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: security-groups-normalized-cidr May 26 14:34:38.844393 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: security_groups_port_filtering.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.845303 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.845812 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: port-security-groups-filtering May 26 14:34:38.846129 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: security_groups_remote_address_group.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.847084 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.847595 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: security-groups-remote-address-group May 26 14:34:38.847916 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: securitygroup.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.857619 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.858152 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: security-group May 26 14:34:38.858524 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: segment.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.859313 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.859824 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension segment not supported by any of loaded plugins May 26 14:34:38.860150 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.861093 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.861603 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins May 26 14:34:38.861938 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: servicetype.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.863069 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.863586 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: service-type May 26 14:34:38.863909 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: sorting.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.864928 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.865243 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: sorting May 26 14:34:38.865572 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: standard_attr_segment.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.866515 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.867069 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension standard-attr-segment not supported by any of loaded plugins May 26 14:34:38.867394 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: standardattrdescription.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.868059 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.868565 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: standard-attr-description May 26 14:34:38.868881 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: stateful_security_group.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.869813 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.870320 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: stateful-security-group May 26 14:34:38.870660 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: stdattrs_common.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.871246 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py May 26 14:34:38.871565 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.872559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.873068 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins May 26 14:34:38.873386 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: subnet_onboard.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.874538 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.875053 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: subnet_onboard May 26 14:34:38.875371 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: subnet_segmentid_writable.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.876282 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.876786 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension subnet-segmentid-writable not supported by any of loaded plugins May 26 14:34:38.877102 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: subnet_service_types.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.878126 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.878672 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: subnet-service-types May 26 14:34:38.878994 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: subnetallocation.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.880113 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.880626 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: subnet_allocation May 26 14:34:38.880949 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.881612 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.882241 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: subnetpool-prefix-ops May 26 14:34:38.882586 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.883505 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.884011 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins May 26 14:34:38.884330 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: tagging.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.885419 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.885947 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: standard-attr-tag May 26 14:34:38.886269 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: timestamp.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.887518 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.888039 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loaded extension: standard-attr-timestamp May 26 14:34:38.888361 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: trunk.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.889392 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.889905 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension trunk not supported by any of loaded plugins May 26 14:34:38.890220 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: trunk_details.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.891153 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.891667 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension trunk-details not supported by any of loaded plugins May 26 14:34:38.891989 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: uplink_status_propagation.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.892903 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.893411 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension uplink-status-propagation not supported by any of loaded plugins May 26 14:34:38.893736 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Loading extension file: vlantransparent.py {{(pid=98337) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 26 14:34:38.894431 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=98337) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 26 14:34:38.894937 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extension vlan-transparent not supported by any of loaded plugins May 26 14:34:38.897483 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:network May 26 14:34:38.898242 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:subnet May 26 14:34:38.900238 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:subnetpool May 26 14:34:38.900855 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:port May 26 14:34:38.902148 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.902615 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service FLAVORS assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.903237 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.903682 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.904012 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:router May 26 14:34:38.904673 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:floatingip May 26 14:34:38.905373 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service METERING assigned prefix: /metering {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.906881 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.907249 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.907603 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98337) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:34:38.908743 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of CountableResource for resource:rbac_policy May 26 14:34:38.909186 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:security_group May 26 14:34:38.909857 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:security_group_rule May 26 14:34:38.910632 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service CORE assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.910958 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:subnetpool May 26 14:34:38.911292 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] subnetpool is already registered May 26 14:34:38.911902 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service CORE assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.912227 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:subnetpool May 26 14:34:38.912546 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] subnetpool is already registered May 26 14:34:38.915218 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.915648 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service FLAVORS assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.916240 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.916656 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.916985 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:router May 26 14:34:38.917312 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] router is already registered May 26 14:34:38.917899 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:floatingip May 26 14:34:38.918223 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] floatingip is already registered May 26 14:34:38.918872 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service METERING assigned prefix: /metering {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.919547 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of CountableResource for resource:rbac_policy May 26 14:34:38.919896 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] rbac_policy is already registered May 26 14:34:38.920439 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:security_group May 26 14:34:38.920757 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] security_group is already registered May 26 14:34:38.921351 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:security_group_rule May 26 14:34:38.921692 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] security_group_rule is already registered May 26 14:34:38.922382 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service CORE assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.922707 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:subnetpool May 26 14:34:38.923027 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] subnetpool is already registered May 26 14:34:38.923620 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.v2.resource_helper [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Service CORE assigned prefix: {{(pid=98337) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 26 14:34:38.923942 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Creating instance of TrackedResource for resource:subnetpool May 26 14:34:38.924256 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING neutron.quota.resource_registry [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] subnetpool is already registered May 26 14:34:38.924919 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: extensions {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.926455 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: address-groups {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.928087 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: address-scopes {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.929330 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: agents {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.930535 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: auto-allocated-topology {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.931764 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: availability_zones {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.933107 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: dhcp-networks {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.934545 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: dhcp-agents {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.935961 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: routers {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.937817 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: flavors {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.940780 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: service_profiles {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.942010 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: next_providers {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.943568 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: service_profiles {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.945062 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: floatingip-pools {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.946291 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: routers {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.948129 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: floatingips {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.949328 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: l3-routers {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.950750 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: l3-agents {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.952155 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: metering-labels {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.953506 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: metering-label-rules {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.954808 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: network-ip-availabilities {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.956071 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: bindings {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.957747 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: quotas {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.959256 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: quotas {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.960688 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: rbac-policies {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.962174 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: security-groups {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.963425 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: security-group-rules {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.964667 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: service-providers {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.966272 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: subnetpools {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.968687 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: subnetpools {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.970136 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:38.971901 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.093505 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.095462 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.097425 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.099546 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.101337 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.103282 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.105071 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.107078 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron.api.extensions [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Extended resource: tags {{(pid=98337) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 26 14:34:39.113536 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING keystonemiddleware.auth_token [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:34:39.119057 dv-cinder-774594-6-iscsi neutron-server[98337]: WARNING keystonemiddleware.auth_token [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:34:39.127827 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_concurrency.lockutils [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Acquired lock "singleton_lock" {{(pid=98337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 26 14:34:39.128322 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_concurrency.lockutils [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Releasing lock "singleton_lock" {{(pid=98337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 26 14:34:39.128986 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO oslo_service.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Starting 2 workers May 26 14:34:39.133822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Started child 98444 {{(pid=98337) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 26 14:34:39.138249 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Started child 98445 {{(pid=98337) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 26 14:34:39.138965 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:39.139794 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO neutron.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Neutron service started, listening on 0.0.0.0:9696 May 26 14:34:39.140394 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Notify callbacks [] for process, before_spawn {{(pid=98337) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:39.140545 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [-] (98444) wsgi starting up on http://0.0.0.0:9696 May 26 14:34:39.142648 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:39.143697 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO oslo_service.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Starting 1 workers May 26 14:34:39.144011 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [-] (98445) wsgi starting up on http://0.0.0.0:9696 May 26 14:34:39.149163 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Started child 98446 {{(pid=98337) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 26 14:34:39.149672 dv-cinder-774594-6-iscsi neutron-server[98337]: INFO oslo_service.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Starting 1 workers May 26 14:34:39.152463 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] calling RpcWorker wait() {{(pid=98446) _wait /opt/stack/neutron/neutron/service.py:128}} May 26 14:34:39.153063 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] returning from RpcWorker wait() {{(pid=98446) _wait /opt/stack/neutron/neutron/service.py:135}} May 26 14:34:39.154103 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Started child 98447 {{(pid=98337) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 26 14:34:39.154223 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:39.154799 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:34:39.154904 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG neutron_lib.callbacks.manager [None req-8ef27705-f0d2-4a31-ad3e-7e2a6d50867b None None] Notify callbacks [] for process, after_spawn {{(pid=98337) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:39.156710 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98337) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 26 14:34:39.156914 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:34:39.157261 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:34:39.157624 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:34:39.158088 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:34:39.158251 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:34:39.158924 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.159096 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:39.159897 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.160326 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.160719 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.161152 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.161883 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.162874 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.163208 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.163512 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.163793 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.163976 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.164137 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.164390 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.164627 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.164946 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.165203 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.165452 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.165723 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.165896 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.166158 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] config_source = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.166459 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.166709 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.166985 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] debug = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.167245 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.167704 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.167964 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.168199 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.168430 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.168708 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.168956 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.169236 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.169492 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.169728 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.169961 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.170217 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.170612 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.170720 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.170961 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.171223 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.171440 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.171940 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] host = dv-cinder-774594-6-iscsi {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.172168 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.172413 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.172666 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.172923 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.173226 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.173404 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.173658 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.173916 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.174161 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.174421 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.174670 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.174905 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.175125 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_dir = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.175367 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.175535 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_options = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.175769 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.176051 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.176310 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.176497 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.176665 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.176828 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.177087 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.177252 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.177506 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.177723 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.177942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.178173 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.178438 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.178710 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.178994 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.179239 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.179481 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.179719 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.179969 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.180200 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.180441 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.180688 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.180905 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.181137 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.181353 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.181566 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.181792 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.182023 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.182246 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.182554 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.182770 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.184239 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.184239 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.184239 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.184239 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.184819 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:34:39.184974 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.184974 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.184974 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.184974 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.185572 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.185572 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.185572 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.185971 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.186196 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.186379 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_journal = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.186526 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_json = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.186703 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.186924 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.187186 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.187416 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.187649 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.187911 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.188091 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.188342 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.190889 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.190889 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.190889 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.190889 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.190889 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.190889 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.191960 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.191960 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.191960 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.191960 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.193112 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.193112 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.193112 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.193112 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.194259 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.194259 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.194259 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.194259 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.199349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.199349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.199349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.199349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.199349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.199349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.199349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.72/identity {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.199349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.200401 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.202692 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.204951 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.204951 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.204951 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.204951 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.204951 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.204951 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.206500 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.206500 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.206500 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.207089 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.207089 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.208029 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.208029 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.208029 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.209024 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.209024 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.209024 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.209545 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.209545 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.209807 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.209942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.210290 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.210583 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.210846 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.211575 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.211575 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.211575 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.211783 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.212001 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.212488 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.213268 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.213268 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.213268 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.213709 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.213709 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.213966 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.214105 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.214247 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.214507 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.215023 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.215742 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.216145 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.217589 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.217589 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.217589 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.217589 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.218167 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.218167 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.218659 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.218659 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.218925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.219087 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.219732 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.219732 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.220015 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.220168 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.220389 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.220614 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.220890 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.221092 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.221356 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.221570 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.221867 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.222078 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.222344 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.222587 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.222873 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.223162 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.223385 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.223703 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.223912 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.224173 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.224515 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.224804 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.225076 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.225347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.225645 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.225911 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.226155 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.226429 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.226698 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.226947 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.227173 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.227439 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.227669 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.227890 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.228102 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.228410 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.228657 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.228881 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.229076 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.229311 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.231497 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.232254 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.232254 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.233671 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.233671 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.234615 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.234880 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.236778 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.72/identity {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.236778 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.236778 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.236778 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.236778 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.238602 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.238602 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.238602 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.239157 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.239413 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.239754 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.240211 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.240211 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.240896 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.240896 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.241863 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.243257 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.243723 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.244227 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.244651 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.245571 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.245700 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36072) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:34:39.245829 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.246453 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.247016 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.247448 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.247896 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.248175 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.248424 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.248649 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.249001 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.249217 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.249469 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.249695 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.249981 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.250184 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.250484 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.250704 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.250925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.251128 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.251380 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.251583 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.251826 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.252042 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.252272 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.252589 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.252837 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.253068 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.253325 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.253561 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.254469 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.254469 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.255305 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [-] 10.222.0.72 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064301 May 26 14:34:39.255453 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.255453 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.255453 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.255453 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.255976 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.255976 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.256233 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.256378 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.256733 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.256893 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.257044 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.257276 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.258851 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.258851 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.258851 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.258851 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.258851 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.259564 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.259564 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.259564 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.259564 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.260304 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.260304 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.260304 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.260727 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.260727 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.260997 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.260997 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.261263 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.261398 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.261593 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.261827 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.262054 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.264274 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.264274 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.265884 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.265884 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.265884 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.266389 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.266389 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.266668 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.267018 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.267171 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.267345 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.267674 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.267895 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.270080 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.270080 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.270080 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.270080 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.270080 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.270942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.270942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.270942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.271337 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.273448 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.273448 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1100:1149'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.273448 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.273448 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.273448 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.274134 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.274134 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.274511 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.276034 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.276034 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.276034 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.276470 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.276606 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.278494 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.278494 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.278494 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.278494 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.279061 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.279061 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.279326 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.279326 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.279599 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.279781 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.280011 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.280258 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.280415 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:34:39.283364 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98337) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 26 14:34:39.283364 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:34:39.283364 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:34:39.283364 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:34:39.288822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:34:39.288822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:34:39.288822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.288822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.288822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.288822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.288822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.289834 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.289834 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.289834 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.289834 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.290389 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.290389 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.290389 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.292893 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.293279 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.293279 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.293279 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.293696 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.293696 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.293953 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.293953 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] config_source = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.294209 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.294209 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.294503 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] debug = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.294651 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.294787 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.294952 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298347 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298882 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.298951 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:34:39.299035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] host = dv-cinder-774594-6-iscsi {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299485 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299996 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299996 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299996 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_dir = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.299996 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.300213 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_options = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.300277 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.300426 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.300745 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.300745 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.300929 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.301369 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.301369 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.301805 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.301950 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.302108 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.302267 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.302471 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.302630 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.302788 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.302945 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.303103 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.303260 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.303418 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.303640 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.304247 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.304247 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.304247 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.304247 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.304662 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.304662 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.304662 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.304939 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.305039 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.305149 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.306925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.306925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.306925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.306925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.306925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.306925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.307501 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.307501 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.307501 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.307501 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.307898 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.307898 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.309236 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.309236 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.309236 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.309236 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_journal = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.309236 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_json = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.309236 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.310162 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.310162 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.310400 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.310516 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.311766 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.311766 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.311766 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:34:39.311766 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.312479 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.312870 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.313238 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.313560 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.313739 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.314340 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.314340 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.314340 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.314559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.314559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.314824 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.314917 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.315054 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.315197 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.315376 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.315528 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.315689 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.316559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.316559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.316559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.316559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.316559 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.316892 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.316892 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.72/identity {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.316892 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.317071 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.317289 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.317399 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.317539 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.317680 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.317829 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.317969 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.318109 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.318276 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.319453 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.319614 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.319935 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.320234 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.320532 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.320832 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.321126 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.321414 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.321735 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.322048 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.322476 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.322822 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.323146 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.323465 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.323796 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.323974 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.324126 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.324286 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.324450 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.324614 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.324772 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.324930 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.325221 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.325511 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.325799 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.326102 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.326276 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.326455 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.326617 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.326783 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.326925 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.327088 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.327770 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.328110 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.328429 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.328741 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.329051 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.329379 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.329712 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.330035 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.331232 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.331598 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.331920 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.332239 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.332688 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.332856 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.333027 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.333198 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.334942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.334942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.334942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.334942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.334942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.334942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.334942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.334942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335457 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335457 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335457 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335457 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335457 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335457 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335798 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335798 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.335924 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.336167 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.336256 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.336375 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337093 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337093 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337093 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337093 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337093 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337415 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337415 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337544 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.337696 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.338010 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.338171 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.338496 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.338810 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.338987 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.339142 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.339478 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.339641 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.340138 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.340286 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.340444 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.340660 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.340762 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.340911 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.341077 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.341236 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.341403 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.341563 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.341722 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.341880 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.342063 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.342222 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.342404 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.342562 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.342813 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.342981 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.343136 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.343286 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.343438 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.343606 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.343765 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.343924 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.72/identity {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.344084 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.344242 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.344395 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.344553 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.344713 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.344872 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.345029 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.345184 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.345349 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.345505 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.345662 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.345819 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.345977 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.346138 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.346295 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.346507 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.346652 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.346809 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.347001 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.347143 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.347267 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.347386 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.347543 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.347728 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.347860 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.348010 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.348167 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.348574 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.348773 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.349143 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.349287 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.349432 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.349596 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.349743 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.349888 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.350033 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.350175 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.350358 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.350550 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.350711 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.350871 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.351029 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.351188 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.351363 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.351521 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.351680 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.351838 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.351995 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.352154 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.352313 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.352471 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.352627 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.352889 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.353052 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.353214 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.353377 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.353537 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.353695 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.353859 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.354023 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.354144 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.354318 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.354493 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.354653 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.354811 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.354971 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.355130 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.355303 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.355461 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.355619 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.355776 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.356717 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.356717 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.356717 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.356717 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.356717 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.356717 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.357413 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.357413 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.357413 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.357413 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.357413 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.357942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.357942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.357942 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.358243 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.358243 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.358483 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.358586 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.358708 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.358884 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.359044 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.359202 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.359360 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.359531 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.359690 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.359839 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.359997 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.360155 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.360314 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.360474 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.360639 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.360808 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.360975 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.361137 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.361306 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.361473 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1100:1149'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.361644 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.361804 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.361967 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.362138 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.362296 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.362479 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.362628 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.362787 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.362965 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.363126 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.363283 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.363441 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.363599 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.363758 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.363916 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.364074 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.364231 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.364388 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.364546 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.364706 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.364863 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.365020 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.365268 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:34:39.365422 dv-cinder-774594-6-iscsi neutron-server[98337]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:34:51.732604 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb17c722-bd15-4686-8b13-170d98e2ac49 None None] get_active_networks_info from dv-cinder-774594-6-iscsi {{(pid=98446) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} May 26 14:34:51.794945 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb17c722-bd15-4686-8b13-170d98e2ac49 None None] No non-hosted networks {{(pid=98446) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} May 26 14:34:51.804477 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-61315ac9-4a14-4012-844c-5e18c533505b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135'] for agent, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:53.270787 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-301b413a-36f2-4514-8e44-b58ded7639d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135'] for agent, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:53.333698 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-077d3524-b326-44de-ac93-69fdfd164cf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:54.514995 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135'] for agent, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:54.517080 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.517858 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.518779 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.519661 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.520286 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.520840 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.521422 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.522004 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.522620 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.523179 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.534777 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.535714 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:34:54.536470 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-774594-6-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:34:54.543066 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-774594-6-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:34:55.946081 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135'] for agent, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:56.979567 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.db.l3_hamode_db [None req-c4aa065a-f92b-428a-9acc-a36e60a3f78a None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 May 26 14:34:57.067932 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4aa065a-f92b-428a-9acc-a36e60a3f78a None None] Routers set() bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:34:57.068749 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4aa065a-f92b-428a-9acc-a36e60a3f78a None None] Router IDs set() for agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}} May 26 14:34:57.440047 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135'] for agent, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:34:58.780781 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 36174) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:34:59.400499 dv-cinder-774594-6-iscsi neutron-server[98445]: WARNING oslo_policy.policy [None req-c5b44a2a-2523-412e-be25-45990a889de2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 26 14:34:59.400983 dv-cinder-774594-6-iscsi neutron-server[98445]: WARNING oslo_policy.policy [None req-c5b44a2a-2523-412e-be25-45990a889de2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 26 14:34:59.621369 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [None req-c5b44a2a-2523-412e-be25-45990a889de2 admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:34:59.622630 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c5b44a2a-2523-412e-be25-45990a889de2 admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.8396120 May 26 14:35:01.975867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 36188) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:02.356060 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'is_default': True, 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'shared': True}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:35:02.454033 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.policy [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98445) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 26 14:35:02.499596 dv-cinder-774594-6-iscsi neutron-server[98445]: WARNING oslo_policy.policy [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 26 14:35:02.499972 dv-cinder-774594-6-iscsi neutron-server[98445]: WARNING oslo_policy.policy [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 26 14:35:02.508410 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.quota [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] Loaded quota_driver: . May 26 14:35:02.524792 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:35:02.587122 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750106675846', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750106675429', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750106736167', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750106725323', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750106718320', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750106708224', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-7852431', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7906061', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-589087', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1557418'] for rbac-policy, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:02.654870 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:02.656197 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3fb8bb03-0c6d-4a3d-80f2-6b24dcd1909b admin admin] 10.222.0.72 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6793878 May 26 14:35:05.280898 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 36202) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:05.641141 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Request body: {'network': {'admin_state_up': True, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'name': 'private', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:35:05.646219 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:35:05.651111 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Usage tracker for resource:network and tenant:4ca7da9fd04c4ec991fe1a24614e257c is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:35:05.655656 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:35:05.661919 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:35:05.673106 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Made reservation on behalf of 4ca7da9fd04c4ec991fe1a24614e257c for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:35:05.676119 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:05.694224 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:05.708751 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:35:05.712717 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Usage tracker for resource:security_group_rule and tenant:4ca7da9fd04c4ec991fe1a24614e257c is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:35:05.718482 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:35:05.724460 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:35:05.825321 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:05.829950 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:05.834418 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:05.853815 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1128} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:35:05.878287 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8750110310126', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:05.878919 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Unsubscribe: segment precommit_create {{(pid=98445) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 26 14:35:05.879567 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Added segment c996365c-2894-4b0a-bb5f-29bf1e32f5a6 of type vlan for network f95ee269-f633-4155-aab8-53c86dc4b8d7 May 26 14:35:05.940061 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3877e051-cfec-4731-a57b-f96b8ad760a8,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:05.966322 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.966666 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.966993 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.967310 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.967670 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.967943 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.968258 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.968569 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.968897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.969203 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.969506 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.969806 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Tracked resource versions report: May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: pushed versions: May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: { 'AddressGroup': {'1.2'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'ConntrackHelper': {'1.0'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Log': {'1.0'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Network': {'1.1'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Port': {'1.7'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'PortForwarding': {'1.2'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'QosPolicy': {'1.8'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SecurityGroup': {'1.4'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SecurityGroupRule': {'1.2'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SubPort': {'1.0'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Subnet': {'1.1'}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Trunk': {'1.1'}} May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: consumer versions: May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: { DHCP agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: L3 agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: Metadata agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: Metering agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: Open vSwitch agent@dv-cinder-774594-6-iscsi: { 'AddressGroup': '1.2', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'ConntrackHelper': '1.0', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Log': '1.0', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Network': '1.1', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Port': '1.7', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'PortForwarding': '1.2', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'QosPolicy': '1.8', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SecurityGroup': '1.4', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SecurityGroupRule': '1.2', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SubPort': '1.0', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Subnet': '1.1', May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Trunk': '1.1'}} May 26 14:35:05.970918 dv-cinder-774594-6-iscsi neutron-server[98445]: {{(pid=98445) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 26 14:35:05.999489 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:06.014713 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:06.048139 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:06.049764 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:35:06.050474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:06.055144 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:06.156651 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 850 time: 0.8745494 May 26 14:35:06.160101 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Pushing event updated for resources: {'Network': ['ID=f95ee269-f633-4155-aab8-53c86dc4b8d7,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:06.163531 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:06.181830 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network f95ee269-f633-4155-aab8-53c86dc4b8d7 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:35:08.853707 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36218) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:09.470132 dv-cinder-774594-6-iscsi neutron-server[98444]: WARNING oslo_policy.policy [None req-555d27ed-b965-4247-9af5-d1b625aa83fe admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 26 14:35:09.470696 dv-cinder-774594-6-iscsi neutron-server[98444]: WARNING oslo_policy.policy [None req-555d27ed-b965-4247-9af5-d1b625aa83fe admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 26 14:35:09.905799 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.policy [None req-555d27ed-b965-4247-9af5-d1b625aa83fe admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98444) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 26 14:35:09.950744 dv-cinder-774594-6-iscsi neutron-server[98444]: WARNING oslo_policy.policy [None req-555d27ed-b965-4247-9af5-d1b625aa83fe admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 26 14:35:09.951125 dv-cinder-774594-6-iscsi neutron-server[98444]: WARNING oslo_policy.policy [None req-555d27ed-b965-4247-9af5-d1b625aa83fe admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 26 14:35:09.959417 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-555d27ed-b965-4247-9af5-d1b625aa83fe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:35:09.961203 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-555d27ed-b965-4247-9af5-d1b625aa83fe admin admin] 10.222.0.72 "GET /v2.0/networks/f95ee269-f633-4155-aab8-53c86dc4b8d7 HTTP/1.1" status: 200 len: 826 time: 1.1062298 May 26 14:35:09.994931 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-1e6e4740-b40b-4ece-a9c2-995b311985cc admin admin] 10.222.0.72 "GET /v2.0/subnetpools/6c55e8a1-6291-4f8f-ad87-e0225e440d4f HTTP/1.1" status: 200 len: 734 time: 0.0277109 May 26 14:35:10.003955 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Request body: {'subnet': {'subnetpool_id': '6c55e8a1-6291-4f8f-ad87-e0225e440d4f', 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7', 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'ip_version': 4}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:35:10.005591 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.quota [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Loaded quota_driver: . May 26 14:35:10.011966 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:35:10.017613 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Usage tracker for resource:subnet and tenant:4ca7da9fd04c4ec991fe1a24614e257c is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:35:10.021019 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:35:10.028322 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:35:10.044095 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Made reservation on behalf of 4ca7da9fd04c4ec991fe1a24614e257c for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:35:10.046958 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Notify callbacks [] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:10.557161 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:10.562195 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:10.642450 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Checking segment: {'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:35:10.642823 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Network hostable DHCP agents. Network: f95ee269-f633-4155-aab8-53c86dc4b8d7, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:35:10.654940 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Pushing event updated for resources: {'Subnet': ['ID=a3b30703-3f69-4293-8fa5-4250f365df61,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:10.664862 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.665212 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.665537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.665829 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.666179 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.666534 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.666849 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.667161 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.667496 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.667801 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.668108 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.668413 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Tracked resource versions report: May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: pushed versions: May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: { 'AddressGroup': {'1.2'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'ConntrackHelper': {'1.0'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Log': {'1.0'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Network': {'1.1'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Port': {'1.7'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'PortForwarding': {'1.2'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'QosPolicy': {'1.8'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SecurityGroup': {'1.4'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SecurityGroupRule': {'1.2'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SubPort': {'1.0'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Subnet': {'1.1'}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Trunk': {'1.1'}} May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: consumer versions: May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: { DHCP agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: L3 agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: Metadata agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: Metering agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: Open vSwitch agent@dv-cinder-774594-6-iscsi: { 'AddressGroup': '1.2', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'ConntrackHelper': '1.0', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Log': '1.0', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Network': '1.1', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Port': '1.7', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'PortForwarding': '1.2', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'QosPolicy': '1.8', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SecurityGroup': '1.4', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SecurityGroupRule': '1.2', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SubPort': '1.0', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Subnet': '1.1', May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Trunk': '1.1'}} May 26 14:35:10.669443 dv-cinder-774594-6-iscsi neutron-server[98444]: {{(pid=98444) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 26 14:35:10.701205 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Network f95ee269-f633-4155-aab8-53c86dc4b8d7 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:35:10.710271 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:10.713904 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, f95ee269-f633-4155-aab8-53c86dc4b8d7) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:35:10.723357 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:35:10.724218 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:10.725122 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba98fa6f-4493-436d-be15-dafce54f3a2f None None] Network f95ee269-f633-4155-aab8-53c86dc4b8d7 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:35:10.748938 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7483363 May 26 14:35:11.046201 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-f95ee269-f633-4155-aab8-53c86dc4b8d7', 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'fixed_ips': [{'subnet_id': 'a3b30703-3f69-4293-8fa5-4250f365df61'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:35:11.047529 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:11.242726 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Allocated IP 172.20.0.2 (f95ee269-f633-4155-aab8-53c86dc4b8d7/a3b30703-3f69-4293-8fa5-4250f365df61/2e9e5b33-08e7-477f-8c60-760e34689056) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:35:11.479812 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:11.495212 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Transition to ACTIVE for port object 2e9e5b33-08e7-477f-8c60-760e34689056 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:35:11.515109 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Transition to ACTIVE for port object 2e9e5b33-08e7-477f-8c60-760e34689056 will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:35:11.523145 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:11.530132 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:11.591106 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Network f95ee269-f633-4155-aab8-53c86dc4b8d7 is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:35:11.594137 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:35:11.600181 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:35:11.605654 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Pushing event updated for resources: {'Port': ['ID=2e9e5b33-08e7-477f-8c60-760e34689056,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:11.615222 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.615556 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.615955 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.616265 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.616610 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.616926 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.617239 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.617538 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.617884 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.618186 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.618553 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.618850 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Tracked resource versions report: May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: pushed versions: May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: { 'AddressGroup': {'1.2'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'ConntrackHelper': {'1.0'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Log': {'1.0'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Network': {'1.1'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Port': {'1.7'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'PortForwarding': {'1.2'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'QosPolicy': {'1.8'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SecurityGroup': {'1.4'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SecurityGroupRule': {'1.2'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SubPort': {'1.0'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Subnet': {'1.1'}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Trunk': {'1.1'}} May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: consumer versions: May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: { DHCP agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: L3 agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: Metadata agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: Metering agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: Open vSwitch agent@dv-cinder-774594-6-iscsi: { 'AddressGroup': '1.2', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'ConntrackHelper': '1.0', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Log': '1.0', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Network': '1.1', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Port': '1.7', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'PortForwarding': '1.2', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'QosPolicy': '1.8', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SecurityGroup': '1.4', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SecurityGroupRule': '1.2', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SubPort': '1.0', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Subnet': '1.1', May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Trunk': '1.1'}} May 26 14:35:11.619927 dv-cinder-774594-6-iscsi neutron-server[98446]: {{(pid=98446) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 26 14:35:11.653546 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:11.710951 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Attempting to bind port 2e9e5b33-08e7-477f-8c60-760e34689056 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:35:11.711561 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Attempting to bind port 2e9e5b33-08e7-477f-8c60-760e34689056 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:35:11.712002 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Attempting to bind port 2e9e5b33-08e7-477f-8c60-760e34689056 on network f95ee269-f633-4155-aab8-53c86dc4b8d7 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:35:11.718170 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 34, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:35:11.718609 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Checking segment: {'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:35:11.719078 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:11.719466 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Bound using segment: {'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:35:11.719983 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Bound port: 2e9e5b33-08e7-477f-8c60-760e34689056, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:35:11.720354 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:11.810961 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] For port 2e9e5b33-08e7-477f-8c60-760e34689056, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:35:11.815987 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] For port 2e9e5b33-08e7-477f-8c60-760e34689056, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=2e9e5b33-08e7-477f-8c60-760e34689056,segment=NetworkSegment(c996365c-2894-4b0a-bb5f-29bf1e32f5a6),segment_id=c996365c-2894-4b0a-bb5f-29bf1e32f5a6)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:35:11.821735 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:11.826974 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:11.921327 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Pushing event updated for resources: {'Port': ['ID=2e9e5b33-08e7-477f-8c60-760e34689056,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:11.924831 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:13.172639 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 36238) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:13.568933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [None req-27b82683-aa58-48ec-a3b5-d9f34d8c40fd admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:35:13.570049 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-27b82683-aa58-48ec-a3b5-d9f34d8c40fd admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3961711 May 26 14:35:15.937293 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36248) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:16.359355 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [None req-74303b28-c7b1-4620-8e98-65f09e8f4f8b admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98444) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:35:16.360431 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-74303b28-c7b1-4620-8e98-65f09e8f4f8b admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.4218223 May 26 14:35:17.305261 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 2e9e5b33-08e7-477f-8c60-760e34689056 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:35:17.390334 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 2e9e5b33-08e7-477f-8c60-760e34689056 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:35:17.429588 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b42078c-0b26-439d-95a0-235d5e8d28be None None] Network f95ee269-f633-4155-aab8-53c86dc4b8d7 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:35:17.543668 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] Provisioning for port 2e9e5b33-08e7-477f-8c60-760e34689056 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:35:17.554350 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] Provisioning complete for port 2e9e5b33-08e7-477f-8c60-760e34689056 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:17.554734 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:17.767286 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:17.806361 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] For port 2e9e5b33-08e7-477f-8c60-760e34689056, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=2e9e5b33-08e7-477f-8c60-760e34689056,segment=NetworkSegment(c996365c-2894-4b0a-bb5f-29bf1e32f5a6),segment_id=c996365c-2894-4b0a-bb5f-29bf1e32f5a6)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:35:17.810800 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:17.812985 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:17.883831 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] Pushing event updated for resources: {'Port': ['ID=2e9e5b33-08e7-477f-8c60-760e34689056,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:17.886982 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:18.042822 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-ce35feea-404e-415f-8d5e-cd1bbbe52cc8 None None] Provisioning complete for port 2e9e5b33-08e7-477f-8c60-760e34689056 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:18.043081 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ce35feea-404e-415f-8d5e-cd1bbbe52cc8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:19.038517 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 36264) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:19.265289 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 2e9e5b33-08e7-477f-8c60-760e34689056 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:35:19.359981 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 2e9e5b33-08e7-477f-8c60-760e34689056 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:19.360262 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:19.412204 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:35:19.417018 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:35:19.420867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Usage tracker for resource:router and tenant:4ca7da9fd04c4ec991fe1a24614e257c is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:35:19.424733 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:35:19.430506 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:35:19.441710 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:19.443321 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:19.465389 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:19.575379 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:19.594864 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:19.596044 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-faf30e23-7d8c-4c52-913d-40b9a079ba85 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5565574 May 26 14:35:21.601003 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-9f359de9-ce78-4133-abe2-9a275b3e7352 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:21.961919 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 36274) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:22.349379 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [None req-c6495190-2882-40ad-b192-662114f44ea1 admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:35:22.350426 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c6495190-2882-40ad-b192-662114f44ea1 admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3875363 May 26 14:35:23.237961 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-4216cadb-45b6-445e-9215-af5f6428ab65 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:24.507002 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:24.745244 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36284) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:25.140266 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'public', 'router:external': True, 'provider:physical_network': 'physnet1', 'provider:network_type': 'flat', 'is_default': True}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:35:25.144950 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:35:25.149293 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Usage tracker for resource:network and tenant:bab17c90a527485280af59f2ebc453a8 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:35:25.153080 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:35:25.160222 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:35:25.172092 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Made reservation on behalf of bab17c90a527485280af59f2ebc453a8 for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:35:25.174673 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:25.191277 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:25.206086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:35:25.210283 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Usage tracker for resource:security_group_rule and tenant:bab17c90a527485280af59f2ebc453a8 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:35:25.213712 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:35:25.221371 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:35:25.321598 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:25.328251 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:25.331329 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:25.346576 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Reserving flat network on physical network physnet1 {{(pid=98444) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} May 26 14:35:25.367491 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b2f3c62-1e2c-4b9c-bc02-fbe48f2a7411,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:25.372888 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8750110310126', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:25.373499 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Unsubscribe: segment precommit_create {{(pid=98444) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 26 14:35:25.373956 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Added segment de92d977-7df2-4448-8678-5399b2199f0b of type flat for network 9026b71b-9440-4cf5-9621-fcfdac3440f9 May 26 14:35:25.380981 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:25.415917 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:25.463671 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:25.465254 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:35:25.465804 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:25.470623 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:25.578256 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.8320112 May 26 14:35:25.582084 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Pushing event updated for resources: {'Network': ['ID=9026b71b-9440-4cf5-9621-fcfdac3440f9,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:25.601496 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:25.609708 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:35:25.833003 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:27.370206 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:27.942043 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36304) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:28.174486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cc46c4e-3fa3-427a-8df5-d0b23ad123a3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:35:28.175795 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-1cc46c4e-3fa3-427a-8df5-d0b23ad123a3 admin admin] 10.222.0.72 "GET /v2.0/subnets/a3b30703-3f69-4293-8fa5-4250f365df61 HTTP/1.1" status: 200 len: 849 time: 0.2325764 May 26 14:35:28.357239 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-37602279-e5ef-4f46-b5a3-721782f7b7fb admin admin] 10.222.0.72 "GET /v2.0/routers/ad42a21e-8280-4ed2-bfba-25859aa80942 HTTP/1.1" status: 200 len: 704 time: 0.1754813 May 26 14:35:28.828159 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.078017 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Allocated IP 172.20.0.1 (f95ee269-f633-4155-aab8-53c86dc4b8d7/a3b30703-3f69-4293-8fa5-4250f365df61/a9567630-cbe2-4da0-b841-f80d55a4ce1d) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:35:29.247492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.264725 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Transition to ACTIVE for port object a9567630-cbe2-4da0-b841-f80d55a4ce1d will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:35:29.320558 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.324273 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:29.421684 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Network f95ee269-f633-4155-aab8-53c86dc4b8d7 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:35:29.424212 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:35:29.428889 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:35:29.429450 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.536084 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Pushing event updated for resources: {'Port': ['ID=a9567630-cbe2-4da0-b841-f80d55a4ce1d,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:29.551463 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:29.669771 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-c3702e06-c452-450e-84bd-1cfd74bcf50e None None] Provisioning for port a9567630-cbe2-4da0-b841-f80d55a4ce1d completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:35:29.674398 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-c3702e06-c452-450e-84bd-1cfd74bcf50e None None] Provisioning complete for port a9567630-cbe2-4da0-b841-f80d55a4ce1d triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:29.674702 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c3702e06-c452-450e-84bd-1cfd74bcf50e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.698358 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.726779 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-c3702e06-c452-450e-84bd-1cfd74bcf50e None None] Port a9567630-cbe2-4da0-b841-f80d55a4ce1d cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:35:29.922470 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.930743 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.931768 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:29.934818 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:30.058604 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Pushing event updated for resources: {'Port': ['ID=a9567630-cbe2-4da0-b841-f80d55a4ce1d,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:30.062693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:30.126698 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Network f95ee269-f633-4155-aab8-53c86dc4b8d7 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:35:30.127790 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:35:30.315989 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Router ad42a21e-8280-4ed2-bfba-25859aa80942 is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98444) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:35:30.356576 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-90119aea-214e-48b0-8508-24f3908b5cfe None None] Provisioning complete for port a9567630-cbe2-4da0-b841-f80d55a4ce1d triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:30.356947 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-90119aea-214e-48b0-8508-24f3908b5cfe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:30.412040 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-90119aea-214e-48b0-8508-24f3908b5cfe None None] Port a9567630-cbe2-4da0-b841-f80d55a4ce1d cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:35:30.470175 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:35:30.479396 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] 10.222.0.72 "PUT /v2.0/routers/ad42a21e-8280-4ed2-bfba-25859aa80942/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.1145449 May 26 14:35:30.480892 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Sync routers for ids ['ad42a21e-8280-4ed2-bfba-25859aa80942'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:35:30.491382 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Routers {'ad42a21e-8280-4ed2-bfba-25859aa80942'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:35:30.492226 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:35:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['ad42a21e-8280-4ed2-bfba-25859aa80942'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:35:30.668157 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Set router ad42a21e-8280-4ed2-bfba-25859aa80942 gateway port host: None {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:35:31.034132 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'name': 'router1', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:35:19Z', 'updated_at': '2021-05-26T14:35:29Z', 'revision_number': 2, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'gw_port_host': None, '_interfaces': [{'id': 'a9567630-cbe2-4da0-b841-f80d55a4ce1d', 'name': '', 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'mac_address': 'fa:16:3e:45:74:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:28Z', 'updated_at': '2021-05-26T14:35:29Z', 'revision_number': 2, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'subnets': [{'id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6c55e8a1-6291-4f8f-ad87-e0225e440d4f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:35:31.039331 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Checking router: ad42a21e-8280-4ed2-bfba-25859aa80942 for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:35:31.039704 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Updating router ad42a21e-8280-4ed2-bfba-25859aa80942 port a9567630-cbe2-4da0-b841-f80d55a4ce1d binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:35:31.092117 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:31.494565 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:31.513614 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Transition to ACTIVE for port object a9567630-cbe2-4da0-b841-f80d55a4ce1d will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:35:31.520381 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:31.527035 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:31.743014 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Pushing event updated for resources: {'Port': ['ID=a9567630-cbe2-4da0-b841-f80d55a4ce1d,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:31.752207 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Attempting to bind port a9567630-cbe2-4da0-b841-f80d55a4ce1d on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:35:31.752542 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Attempting to bind port a9567630-cbe2-4da0-b841-f80d55a4ce1d by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:35:31.752981 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Attempting to bind port a9567630-cbe2-4da0-b841-f80d55a4ce1d on network f95ee269-f633-4155-aab8-53c86dc4b8d7 {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:35:31.756939 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.757275 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.757605 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.757927 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.758245 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.758588 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.758923 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.759224 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.759542 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.759849 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.760186 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.760497 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Tracked resource versions report: May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: pushed versions: May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: { 'AddressGroup': {'1.2'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'ConntrackHelper': {'1.0'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Log': {'1.0'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Network': {'1.1'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Port': {'1.7'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'PortForwarding': {'1.2'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'QosPolicy': {'1.8'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SecurityGroup': {'1.4'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SecurityGroupRule': {'1.2'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SubPort': {'1.0'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Subnet': {'1.1'}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Trunk': {'1.1'}} May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: consumer versions: May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: { DHCP agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: L3 agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: Metadata agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: Metering agent@dv-cinder-774594-6-iscsi: {}, May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: Open vSwitch agent@dv-cinder-774594-6-iscsi: { 'AddressGroup': '1.2', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'ConntrackHelper': '1.0', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Log': '1.0', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Network': '1.1', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Port': '1.7', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'PortForwarding': '1.2', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'QosPolicy': '1.8', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SecurityGroup': '1.4', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SecurityGroupRule': '1.2', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SubPort': '1.0', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Subnet': '1.1', May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Trunk': '1.1'}} May 26 14:35:31.761556 dv-cinder-774594-6-iscsi neutron-server[98447]: {{(pid=98447) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 26 14:35:31.765951 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 35, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:35:31.766383 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Checking segment: {'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:35:31.766843 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:31.767220 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Bound using segment: {'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:35:31.767718 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Bound port: a9567630-cbe2-4da0-b841-f80d55a4ce1d, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c996365c-2894-4b0a-bb5f-29bf1e32f5a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1128, 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:35:31.768085 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:31.777060 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:31.855657 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] For port a9567630-cbe2-4da0-b841-f80d55a4ce1d, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:35:31.859730 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] For port a9567630-cbe2-4da0-b841-f80d55a4ce1d, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a9567630-cbe2-4da0-b841-f80d55a4ce1d,segment=NetworkSegment(c996365c-2894-4b0a-bb5f-29bf1e32f5a6),segment_id=c996365c-2894-4b0a-bb5f-29bf1e32f5a6)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:35:31.865674 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:31.871825 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:31.968777 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Pushing event updated for resources: {'Port': ['ID=a9567630-cbe2-4da0-b841-f80d55a4ce1d,revision_number=4']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:31.972068 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Routers {'ad42a21e-8280-4ed2-bfba-25859aa80942'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:35:31.973690 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:35:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['ad42a21e-8280-4ed2-bfba-25859aa80942'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:35:32.021143 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:32.174823 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] Set router ad42a21e-8280-4ed2-bfba-25859aa80942 gateway port host: None {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:35:32.541341 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'name': 'router1', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:35:19Z', 'updated_at': '2021-05-26T14:35:29Z', 'revision_number': 2, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'gw_port_host': None, '_interfaces': [{'id': 'a9567630-cbe2-4da0-b841-f80d55a4ce1d', 'name': '', 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'mac_address': 'fa:16:3e:45:74:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:28Z', 'updated_at': '2021-05-26T14:35:31Z', 'revision_number': 4, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'subnets': [{'id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6c55e8a1-6291-4f8f-ad87-e0225e440d4f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:35:32.545959 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84603249-a8dd-453f-a576-b4ad7077f11c None None] The sync data for ids ['ad42a21e-8280-4ed2-bfba-25859aa80942'] in dv-cinder-774594-6-iscsi is: [{'id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'name': 'router1', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:35:19Z', 'updated_at': '2021-05-26T14:35:29Z', 'revision_number': 2, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'gw_port_host': None, '_interfaces': [{'id': 'a9567630-cbe2-4da0-b841-f80d55a4ce1d', 'name': '', 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'mac_address': 'fa:16:3e:45:74:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:28Z', 'updated_at': '2021-05-26T14:35:31Z', 'revision_number': 4, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'subnets': [{'id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6c55e8a1-6291-4f8f-ad87-e0225e440d4f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:35:32.646160 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36326) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:32.800659 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c443bc67-474e-4e1a-96c4-2bf7ea1ca537 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:35:32.801119 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c443bc67-474e-4e1a-96c4-2bf7ea1ca537 admin admin] Synchronizing usage tracker for tenant:bab17c90a527485280af59f2ebc453a8 on resource:network {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:35:32.819822 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c443bc67-474e-4e1a-96c4-2bf7ea1ca537 admin admin] Unset dirty status for tenant:bab17c90a527485280af59f2ebc453a8 on resource:network {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:35:32.821065 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c443bc67-474e-4e1a-96c4-2bf7ea1ca537 admin admin] 10.222.0.72 "GET /v2.0/networks/9026b71b-9440-4cf5-9621-fcfdac3440f9 HTTP/1.1" status: 200 len: 842 time: 0.1733449 May 26 14:35:32.830561 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.27.3.1', 'enable_dhcp': False, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'name': 'public-subnet', 'cidr': '172.27.3.0/24'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:35:32.836476 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:35:32.841625 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Usage tracker for resource:subnet and tenant:bab17c90a527485280af59f2ebc453a8 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:35:32.844654 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:35:32.851339 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:35:32.864247 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Made reservation on behalf of bab17c90a527485280af59f2ebc453a8 for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:35:32.866959 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:33.363017 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.objects.ports [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=98444) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}} May 26 14:35:33.363469 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:33.367400 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:33.433187 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6e5be695-73c1-4c55-ae2a-14b7ccca7abf,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:33.441141 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:33.445489 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:35:33.445837 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Network hostable DHCP agents. Network: 9026b71b-9440-4cf5-9621-fcfdac3440f9, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:35:33.465265 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:35:33.476572 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 9026b71b-9440-4cf5-9621-fcfdac3440f9) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:35:33.481465 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:35:33.482291 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:33.487508 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aeeb3798-d86a-4a98-92d6-d8e1f0a45b5e None None] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:35:33.506903 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6797523 May 26 14:35:33.765589 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cb0c1f7-79cf-4d9a-99d7-57389bb719bc None None] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:35:35.207184 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:35:35.312285 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a9567630-cbe2-4da0-b841-f80d55a4ce1d up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:35:35.388824 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port a9567630-cbe2-4da0-b841-f80d55a4ce1d completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:35:35.394609 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port a9567630-cbe2-4da0-b841-f80d55a4ce1d triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:35.394960 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:35.518582 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:35.551711 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port a9567630-cbe2-4da0-b841-f80d55a4ce1d, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a9567630-cbe2-4da0-b841-f80d55a4ce1d,segment=NetworkSegment(c996365c-2894-4b0a-bb5f-29bf1e32f5a6),segment_id=c996365c-2894-4b0a-bb5f-29bf1e32f5a6)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:35:35.555637 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:35.558264 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8703c804-8774-4121-bf95-7a46764f9248 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:35.630865 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=a9567630-cbe2-4da0-b841-f80d55a4ce1d,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:35.634920 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:35.765671 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36340) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:35.970614 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0ce1c6f6-0c0f-44dc-a711-f4cdd8e26b44 admin admin] 10.222.0.72 "GET /v2.0/routers/ad42a21e-8280-4ed2-bfba-25859aa80942 HTTP/1.1" status: 200 len: 710 time: 0.2037280 May 26 14:35:36.107002 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cacaf0b-0122-4f07-9c1d-efa2b7596b54 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:35:36.108692 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5cacaf0b-0122-4f07-9c1d-efa2b7596b54 admin admin] 10.222.0.72 "GET /v2.0/networks/9026b71b-9440-4cf5-9621-fcfdac3440f9 HTTP/1.1" status: 200 len: 886 time: 0.1327953 May 26 14:35:36.121119 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:35:36.617578 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:37.003457 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:37.058000 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:37.193840 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Allocated IP 172.27.3.109 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/4ea17446-545d-4380-9b54-cc54cdb4a92e) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:35:37.276702 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a9567630-cbe2-4da0-b841-f80d55a4ce1d up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:35:37.346050 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:37.346455 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port a9567630-cbe2-4da0-b841-f80d55a4ce1d triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:37.346830 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:37.376242 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:37.380143 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:37.438999 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:35:37.440066 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:35:37.445431 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:35:37.560246 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Pushing event updated for resources: {'Port': ['ID=4ea17446-545d-4380-9b54-cc54cdb4a92e,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:37.569433 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:37.826762 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:38.208528 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:38.212369 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-417854', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-417801', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-415874'] for router, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:38.389627 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Router ad42a21e-8280-4ed2-bfba-25859aa80942 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:35:38.569781 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:35:38.578502 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:38.579698 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] 10.222.0.72 "PUT /v2.0/routers/ad42a21e-8280-4ed2-bfba-25859aa80942 HTTP/1.1" status: 200 len: 890 time: 2.4649355 May 26 14:35:38.580085 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-512da69d-d480-496d-b968-e960556db5ad None None] Sync routers for ids ['ad42a21e-8280-4ed2-bfba-25859aa80942'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:35:38.591402 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-512da69d-d480-496d-b968-e960556db5ad None None] Routers {'ad42a21e-8280-4ed2-bfba-25859aa80942'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:35:38.592005 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-512da69d-d480-496d-b968-e960556db5ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:35:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['ad42a21e-8280-4ed2-bfba-25859aa80942'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:35:38.812391 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-512da69d-d480-496d-b968-e960556db5ad None None] Set router ad42a21e-8280-4ed2-bfba-25859aa80942 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:35:39.167531 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-512da69d-d480-496d-b968-e960556db5ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'name': 'router1', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.109'}], 'enable_snat': True}, 'gw_port_id': '4ea17446-545d-4380-9b54-cc54cdb4a92e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:35:19Z', 'updated_at': '2021-05-26T14:35:37Z', 'revision_number': 4, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'gw_port': {'id': '4ea17446-545d-4380-9b54-cc54cdb4a92e', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:60:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:37Z', 'updated_at': '2021-05-26T14:35:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'a9567630-cbe2-4da0-b841-f80d55a4ce1d', 'name': '', 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'mac_address': 'fa:16:3e:45:74:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:28Z', 'updated_at': '2021-05-26T14:35:35Z', 'revision_number': 5, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'subnets': [{'id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6c55e8a1-6291-4f8f-ad87-e0225e440d4f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:35:39.173263 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-512da69d-d480-496d-b968-e960556db5ad None None] Checking router: ad42a21e-8280-4ed2-bfba-25859aa80942 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:35:39.173632 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-512da69d-d480-496d-b968-e960556db5ad None None] Updating router ad42a21e-8280-4ed2-bfba-25859aa80942 port 4ea17446-545d-4380-9b54-cc54cdb4a92e binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:35:39.228882 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-512da69d-d480-496d-b968-e960556db5ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:39.569357 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-512da69d-d480-496d-b968-e960556db5ad None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:39.581514 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-512da69d-d480-496d-b968-e960556db5ad None None] Transition to ACTIVE for port object 4ea17446-545d-4380-9b54-cc54cdb4a92e will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:35:39.588716 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-512da69d-d480-496d-b968-e960556db5ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:39.592943 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:39.669977 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-512da69d-d480-496d-b968-e960556db5ad None None] Attempting to bind port 4ea17446-545d-4380-9b54-cc54cdb4a92e on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:35:39.670357 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-512da69d-d480-496d-b968-e960556db5ad None None] Attempting to bind port 4ea17446-545d-4380-9b54-cc54cdb4a92e by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:35:39.670717 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-512da69d-d480-496d-b968-e960556db5ad None None] Attempting to bind port 4ea17446-545d-4380-9b54-cc54cdb4a92e on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:35:39.679509 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-512da69d-d480-496d-b968-e960556db5ad None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 35, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:35:39.679882 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-512da69d-d480-496d-b968-e960556db5ad None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:35:39.680273 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-512da69d-d480-496d-b968-e960556db5ad None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:39.680663 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-512da69d-d480-496d-b968-e960556db5ad None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:35:39.681125 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-512da69d-d480-496d-b968-e960556db5ad None None] Bound port: 4ea17446-545d-4380-9b54-cc54cdb4a92e, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:35:39.681488 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-512da69d-d480-496d-b968-e960556db5ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:39.703590 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708fc265-c610-4de8-9857-f5ecc2864809 None None] Pushing event updated for resources: {'Port': ['ID=4ea17446-545d-4380-9b54-cc54cdb4a92e,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:39.710635 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-708fc265-c610-4de8-9857-f5ecc2864809 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:39.754262 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-512da69d-d480-496d-b968-e960556db5ad None None] For port 4ea17446-545d-4380-9b54-cc54cdb4a92e, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:35:39.757471 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-512da69d-d480-496d-b968-e960556db5ad None None] For port 4ea17446-545d-4380-9b54-cc54cdb4a92e, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=4ea17446-545d-4380-9b54-cc54cdb4a92e,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:35:39.761590 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-512da69d-d480-496d-b968-e960556db5ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:39.766443 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:39.842419 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-512da69d-d480-496d-b968-e960556db5ad None None] Routers {'ad42a21e-8280-4ed2-bfba-25859aa80942'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:35:39.842944 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-512da69d-d480-496d-b968-e960556db5ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:35:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['ad42a21e-8280-4ed2-bfba-25859aa80942'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:35:39.895727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708fc265-c610-4de8-9857-f5ecc2864809 None None] Pushing event updated for resources: {'Port': ['ID=4ea17446-545d-4380-9b54-cc54cdb4a92e,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:39.906119 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-708fc265-c610-4de8-9857-f5ecc2864809 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:40.028766 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-512da69d-d480-496d-b968-e960556db5ad None None] Set router ad42a21e-8280-4ed2-bfba-25859aa80942 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:35:40.389162 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-512da69d-d480-496d-b968-e960556db5ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'name': 'router1', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.109'}], 'enable_snat': True}, 'gw_port_id': '4ea17446-545d-4380-9b54-cc54cdb4a92e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:35:19Z', 'updated_at': '2021-05-26T14:35:37Z', 'revision_number': 4, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'gw_port': {'id': '4ea17446-545d-4380-9b54-cc54cdb4a92e', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:60:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:37Z', 'updated_at': '2021-05-26T14:35:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'a9567630-cbe2-4da0-b841-f80d55a4ce1d', 'name': '', 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'mac_address': 'fa:16:3e:45:74:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:28Z', 'updated_at': '2021-05-26T14:35:35Z', 'revision_number': 5, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'subnets': [{'id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6c55e8a1-6291-4f8f-ad87-e0225e440d4f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:35:40.393377 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-512da69d-d480-496d-b968-e960556db5ad None None] The sync data for ids ['ad42a21e-8280-4ed2-bfba-25859aa80942'] in dv-cinder-774594-6-iscsi is: [{'id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'name': 'router1', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.109'}], 'enable_snat': True}, 'gw_port_id': '4ea17446-545d-4380-9b54-cc54cdb4a92e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:35:19Z', 'updated_at': '2021-05-26T14:35:37Z', 'revision_number': 4, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'gw_port': {'id': '4ea17446-545d-4380-9b54-cc54cdb4a92e', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:60:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:37Z', 'updated_at': '2021-05-26T14:35:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'a9567630-cbe2-4da0-b841-f80d55a4ce1d', 'name': '', 'network_id': 'f95ee269-f633-4155-aab8-53c86dc4b8d7', 'tenant_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'mac_address': 'fa:16:3e:45:74:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad42a21e-8280-4ed2-bfba-25859aa80942', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:35:28Z', 'updated_at': '2021-05-26T14:35:35Z', 'revision_number': 5, 'project_id': '4ca7da9fd04c4ec991fe1a24614e257c', 'subnets': [{'id': 'a3b30703-3f69-4293-8fa5-4250f365df61', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6c55e8a1-6291-4f8f-ad87-e0225e440d4f'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:35:40.947503 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36350) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:35:41.067215 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-cb936c0a-d77d-47df-a044-5484bfd9205c admin admin] 10.222.0.72 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1185200 May 26 14:35:41.304367 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 4ea17446-545d-4380-9b54-cc54cdb4a92e up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:35:41.371394 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 4ea17446-545d-4380-9b54-cc54cdb4a92e completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:35:41.376373 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 4ea17446-545d-4380-9b54-cc54cdb4a92e triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:41.376750 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:41.497953 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:41.514995 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 4ea17446-545d-4380-9b54-cc54cdb4a92e, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=4ea17446-545d-4380-9b54-cc54cdb4a92e,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:35:41.520030 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:41.522757 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-708fc265-c610-4de8-9857-f5ecc2864809 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:35:41.593137 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=4ea17446-545d-4380-9b54-cc54cdb4a92e,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:35:41.596290 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:35:43.284101 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 4ea17446-545d-4380-9b54-cc54cdb4a92e up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:35:43.357492 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 4ea17446-545d-4380-9b54-cc54cdb4a92e triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:35:43.357863 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:51.607936 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-213bb3a3-936f-4446-9c88-c661fd3df574 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:53.238090 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-da5ed46a-9f4d-4e2b-b6b2-de80c03c98e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:54.529134 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:55.845934 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:35:57.403145 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:12.206944 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:36:21.612698 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3dc8188e-2b14-4c54-8f9e-a7c563c7f0af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:23.233587 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-749d4af8-3553-4db3-abb9-5f144d4420ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:24.508364 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:25.841185 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:27.398198 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:49.206552 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:36:51.604559 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ce324dc-56dc-45a1-ad94-46ec1a2f1bee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:53.229661 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c30b7df8-7fc1-4caa-910c-6b7a729043aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:54.508164 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:55.842778 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:36:57.393322 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:16.231159 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36920) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:16.305842 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.pecan_wsgi.hooks.translation [None req-a2378cad-fd7e-450e-9101-029158d1288b admin admin] GET failed (client error): The resource could not be found. May 26 14:37:16.307206 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a2378cad-fd7e-450e-9101-029158d1288b admin admin] 10.222.0.72 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0750475 May 26 14:37:16.441247 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9495f3ea-68e6-4d1d-8ed4-491e2cb3c889 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:16.442784 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9495f3ea-68e6-4d1d-8ed4-491e2cb3c889 admin admin] 10.222.0.72 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 873 time: 0.1314063 May 26 14:37:18.565923 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36930) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:18.693483 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36d8d237-779f-40b3-89ec-171d0e46571a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:18.694034 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-36d8d237-779f-40b3-89ec-171d0e46571a admin admin] Synchronizing usage tracker for tenant:bab17c90a527485280af59f2ebc453a8 on resource:subnet {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:37:18.712911 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-36d8d237-779f-40b3-89ec-171d0e46571a admin admin] Unset dirty status for tenant:bab17c90a527485280af59f2ebc453a8 on resource:subnet {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:37:18.714073 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-36d8d237-779f-40b3-89ec-171d0e46571a admin admin] 10.222.0.72 "GET /v2.0/subnets/a3b30703-3f69-4293-8fa5-4250f365df61 HTTP/1.1" status: 200 len: 849 time: 0.1471572 May 26 14:37:18.726280 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:37:18.845457 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Notify callbacks [] for subnet, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:19.046906 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8750110298269'] for subnet, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:19.050764 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f6a0f325-21f7-4e1b-8511-263b7c8f0d71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:37:19.089716 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:19.090290 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:19.092099 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] 10.222.0.72 "PUT /v2.0/subnets/a3b30703-3f69-4293-8fa5-4250f365df61 HTTP/1.1" status: 200 len: 868 time: 0.3692403 May 26 14:37:19.094102 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-215779b1-72a6-48c3-90ff-448289dd6bb6 None None] Network f95ee269-f633-4155-aab8-53c86dc4b8d7 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:37:19.117332 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Pushing event updated for resources: {'Subnet': ['ID=a3b30703-3f69-4293-8fa5-4250f365df61,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:37:19.125329 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.125793 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.126093 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.126467 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.126811 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.127172 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.127519 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.127850 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.128201 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.128526 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.128825 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.129148 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:37:19.133181 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:37:19.589324 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-b2c14f72-6715-47ec-9f87-5fe7b83fd506 None None] Provisioning complete for port a9567630-cbe2-4da0-b841-f80d55a4ce1d triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:37:19.589696 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b2c14f72-6715-47ec-9f87-5fe7b83fd506 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:19.715940 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-b2c14f72-6715-47ec-9f87-5fe7b83fd506 None None] Provisioning complete for port 2e9e5b33-08e7-477f-8c60-760e34689056 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:37:19.716164 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b2c14f72-6715-47ec-9f87-5fe7b83fd506 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:21.212953 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 36940) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:21.415326 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2b020e5-7599-430e-961e-a85ddc432d91 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:21.415795 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2b020e5-7599-430e-961e-a85ddc432d91 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:21.417322 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-a2b020e5-7599-430e-961e-a85ddc432d91 admin admin] 10.222.0.72 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.2034466 May 26 14:37:21.609641 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a944169e-a1bc-43f7-a6ee-67f01328d0a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:23.234610 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-12c00dc6-8a57-451d-a6d0-25e41186398d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:23.526280 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36950) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:23.705252 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5249356a-216b-4304-85e9-7a314f2eb201 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:23.705623 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5249356a-216b-4304-85e9-7a314f2eb201 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:23.707159 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5249356a-216b-4304-85e9-7a314f2eb201 admin admin] 10.222.0.72 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.1798787 May 26 14:37:24.505322 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:25.811233 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36960) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:25.846139 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:25.994889 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f63f5ad-13da-40da-8d47-b9214eeb2ec4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:25.996145 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7f63f5ad-13da-40da-8d47-b9214eeb2ec4 admin admin] 10.222.0.72 "GET /v2.0/networks/9026b71b-9440-4cf5-9621-fcfdac3440f9 HTTP/1.1" status: 200 len: 886 time: 0.1839771 May 26 14:37:26.205506 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:37:27.396734 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:28.092036 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36970) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:28.272682 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-123bfb30-c90d-4fa7-94b5-e1acafa17ddf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:28.273966 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-123bfb30-c90d-4fa7-94b5-e1acafa17ddf admin admin] 10.222.0.72 "GET /v2.0/networks/f95ee269-f633-4155-aab8-53c86dc4b8d7 HTTP/1.1" status: 200 len: 870 time: 0.1809349 May 26 14:37:30.380652 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36980) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:30.537957 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a260cb39-9a88-4fef-85a1-bbd17aa2b1dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:30.538444 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a260cb39-9a88-4fef-85a1-bbd17aa2b1dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:30.539979 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a260cb39-9a88-4fef-85a1-bbd17aa2b1dc admin admin] 10.222.0.72 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1583381 May 26 14:37:32.664120 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 36990) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:32.774700 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5cc4e06-8ffb-4d75-8002-17949bf31a8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:32.775111 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5cc4e06-8ffb-4d75-8002-17949bf31a8a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:32.776712 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f5cc4e06-8ffb-4d75-8002-17949bf31a8a admin admin] 10.222.0.72 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1115317 May 26 14:37:34.886730 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37000) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:34.996205 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0322ecd2-44e1-413a-9fe2-99a27d6bb6c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:34.997817 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0322ecd2-44e1-413a-9fe2-99a27d6bb6c4 admin admin] 10.222.0.72 "GET /v2.0/subnets/6e5be695-73c1-4c55-ae2a-14b7ccca7abf HTTP/1.1" status: 200 len: 816 time: 0.1100473 May 26 14:37:37.105632 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37010) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:37:37.216757 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca9ded40-b7b9-4d49-bdd1-307f3fcf8f2e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:37:37.218125 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-ca9ded40-b7b9-4d49-bdd1-307f3fcf8f2e admin admin] 10.222.0.72 "GET /v2.0/subnets/a3b30703-3f69-4293-8fa5-4250f365df61 HTTP/1.1" status: 200 len: 868 time: 0.1114695 May 26 14:37:51.605129 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-2a45fe80-46c6-4bdc-869e-ebe4fa3f17f2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:53.239850 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f54c2d63-cf08-4928-b79b-1fe34bc22346 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:54.509930 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:55.848327 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:37:57.398661 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:00.239168 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37054) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:38:00.290854 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [None req-35c3e77e-1b14-4eed-8a08-60252e442602 admin admin] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:38:00.291871 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-35c3e77e-1b14-4eed-8a08-60252e442602 admin admin] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0517561 May 26 14:38:02.507052 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37064) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:38:02.578263 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4b30445-89a3-4a09-bdf0-6ec17b27718b admin admin] GET failed (client error): The resource could not be found. May 26 14:38:02.579551 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e4b30445-89a3-4a09-bdf0-6ec17b27718b admin admin] 10.222.0.72 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0715051 May 26 14:38:02.732530 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-038bad96-8c8f-4e41-a7d8-2f6608220411 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:38:02.734057 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-038bad96-8c8f-4e41-a7d8-2f6608220411 admin admin] 10.222.0.72 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1502745 May 26 14:38:03.205174 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:38:04.886352 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37074) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:38:04.947052 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:38:04.951922 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:38:04.962788 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:38:04.974599 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Made reservation on behalf of bab17c90a527485280af59f2ebc453a8 for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:38:04.977074 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:05.068396 dv-cinder-774594-6-iscsi neutron-server[98445]: WARNING neutron.services.revisions.revision_plugin [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Could not find related network for resource to bump revision. May 26 14:38:05.082373 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1148} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:38:05.093410 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:05.093750 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Added segment 46de2e99-b232-4f85-b906-225f5c51afe6 of type vlan for network 14d03d57-1203-4ea8-864d-d000917df145 May 26 14:38:05.122208 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:05.158664 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:05.160696 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:38:05.161579 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:05.166307 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:38:05.265804 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Pushing event updated for resources: {'Network': ['ID=14d03d57-1203-4ea8-864d-d000917df145,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:38:05.270391 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 848 time: 0.3825221 May 26 14:38:05.274689 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.275042 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.275366 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.275677 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.275984 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.276316 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.276625 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.276933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.277248 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.277554 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.277850 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.278184 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:05.283787 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:38:05.291872 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 14d03d57-1203-4ea8-864d-d000917df145 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:38:07.430622 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37084) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:38:07.503167 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.pecan_wsgi.hooks.translation [None req-7e93fc4c-f0fd-43e4-89fd-c3d0570e56ce admin admin] GET failed (client error): The resource could not be found. May 26 14:38:07.504599 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7e93fc4c-f0fd-43e4-89fd-c3d0570e56ce admin admin] 10.222.0.72 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0729766 May 26 14:38:07.612713 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d10da1e-3675-4c82-8da6-eaecd9f76520 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:38:07.614263 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7d10da1e-3675-4c82-8da6-eaecd9f76520 admin admin] 10.222.0.72 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 827 time: 0.1055362 May 26 14:38:07.623780 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'ip_version': 4, 'description': 'shared-subnet', 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:38:07.628091 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:38:07.641774 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:38:07.655330 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Made reservation on behalf of bab17c90a527485280af59f2ebc453a8 for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:38:07.657644 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Notify callbacks [] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:08.058129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:08.061733 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:38:08.126656 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Pushing event updated for resources: {'Subnet': ['ID=c699aeff-c66c-4ae8-a570-fee2c07c0bd0,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:38:08.131950 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:38:08.140772 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Checking segment: {'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:38:08.141118 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Network hostable DHCP agents. Network: 14d03d57-1203-4ea8-864d-d000917df145, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:38:08.160209 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Network 14d03d57-1203-4ea8-864d-d000917df145 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:38:08.170820 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 14d03d57-1203-4ea8-864d-d000917df145) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:38:08.175143 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:38:08.175711 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:08.180220 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-209ffc72-fff0-46a9-a0a7-0a6bcfead3af None None] Network 14d03d57-1203-4ea8-864d-d000917df145 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:38:08.202716 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b328c4d8-934a-4513-bf66-c7a3081b199b admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5822871 May 26 14:38:08.438395 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-14d03d57-1203-4ea8-864d-d000917df145', 'network_id': '14d03d57-1203-4ea8-864d-d000917df145', 'tenant_id': 'bab17c90a527485280af59f2ebc453a8', 'fixed_ips': [{'subnet_id': 'c699aeff-c66c-4ae8-a570-fee2c07c0bd0'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:38:08.439251 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:08.604755 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Allocated IP 192.168.233.2 (14d03d57-1203-4ea8-864d-d000917df145/c699aeff-c66c-4ae8-a570-fee2c07c0bd0/dc77c82c-eeee-4af8-8854-26305f45034f) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:38:08.816766 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:08.827189 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Transition to ACTIVE for port object dc77c82c-eeee-4af8-8854-26305f45034f will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:38:08.846662 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Transition to ACTIVE for port object dc77c82c-eeee-4af8-8854-26305f45034f will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:38:08.853757 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:08.858822 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3e62e5af-76c1-4c23-90d3-3465879dccfd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:38:08.925267 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Network 14d03d57-1203-4ea8-864d-d000917df145 is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:38:08.930255 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:38:08.935628 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:38:08.937858 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Pushing event updated for resources: {'Port': ['ID=dc77c82c-eeee-4af8-8854-26305f45034f,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:38:08.947308 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.947647 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.947965 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.948288 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.948607 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.948943 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.949259 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.949575 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.949906 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.950216 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.950564 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.950893 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:38:08.978617 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:38:09.041935 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Attempting to bind port dc77c82c-eeee-4af8-8854-26305f45034f on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:38:09.042287 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Attempting to bind port dc77c82c-eeee-4af8-8854-26305f45034f by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:38:09.042700 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Attempting to bind port dc77c82c-eeee-4af8-8854-26305f45034f on network 14d03d57-1203-4ea8-864d-d000917df145 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:38:09.048397 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 37, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:38:09.048797 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Checking segment: {'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:38:09.049186 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:09.049572 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Bound using segment: {'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:38:09.050019 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Bound port: dc77c82c-eeee-4af8-8854-26305f45034f, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:38:09.050963 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:09.141838 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] For port dc77c82c-eeee-4af8-8854-26305f45034f, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:38:09.145656 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] For port dc77c82c-eeee-4af8-8854-26305f45034f, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=dc77c82c-eeee-4af8-8854-26305f45034f,segment=NetworkSegment(46de2e99-b232-4f85-b906-225f5c51afe6),segment_id=46de2e99-b232-4f85-b906-225f5c51afe6)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:38:09.150732 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:09.155637 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:38:09.235727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Pushing event updated for resources: {'Port': ['ID=dc77c82c-eeee-4af8-8854-26305f45034f,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:38:09.240248 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:38:10.061718 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1f980a3-fab5-4e3c-b194-b17483fe39b1 None None] Network 14d03d57-1203-4ea8-864d-d000917df145 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:38:10.188933 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-bb8884f9-4bbc-403b-b892-02dbac139583 None None] Provisioning for port dc77c82c-eeee-4af8-8854-26305f45034f completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:38:11.423398 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device dc77c82c-eeee-4af8-8854-26305f45034f up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:38:11.498395 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port dc77c82c-eeee-4af8-8854-26305f45034f completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:38:11.503711 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port dc77c82c-eeee-4af8-8854-26305f45034f triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:38:11.504095 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:11.630026 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:11.662921 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port dc77c82c-eeee-4af8-8854-26305f45034f, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=dc77c82c-eeee-4af8-8854-26305f45034f,segment=NetworkSegment(46de2e99-b232-4f85-b906-225f5c51afe6),segment_id=46de2e99-b232-4f85-b906-225f5c51afe6)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:38:11.667685 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:11.669848 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:38:11.737413 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=dc77c82c-eeee-4af8-8854-26305f45034f,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:38:11.745845 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:38:13.404054 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device dc77c82c-eeee-4af8-8854-26305f45034f up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:38:13.472546 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port dc77c82c-eeee-4af8-8854-26305f45034f triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:38:13.472793 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:21.600173 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-62dcd485-7270-4f30-9ce7-fa1d802bded0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:23.244924 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-fdb8694f-7afc-40d9-9bbc-f56fcb97d301 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:24.514393 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:25.851784 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:27.403742 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:40.205101 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:38:51.617180 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-05ab5cea-aeda-4a80-9074-aa5978dc52fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:53.250208 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-11dfd6fe-79f6-482d-abf7-99e58c926a56 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:54.518633 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:55.854922 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:38:57.406117 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:14.950575 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37134) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:39:14.956629 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [None req-9624a3a9-e6a1-49df-9054-cd92ea51056f tempest-verify_tempest_config-1358081039 tempest-verify_tempest_config-1358081039-project] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:39:14.957598 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9624a3a9-e6a1-49df-9054-cd92ea51056f tempest-verify_tempest_config-1358081039 tempest-verify_tempest_config-1358081039-project] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0060289 May 26 14:39:15.291043 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37152) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:39:15.412736 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:15.427535 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:39:15.431544 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Usage tracker for resource:security_group_rule and tenant:f9fc4d9541d44465923f8227cd999f4d is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:39:15.434440 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:39:15.440183 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:39:15.525365 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:15.530023 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:15.537295 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:39:15.575083 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07db47f4-6193-4e72-a7fd-aca45a1a8d41,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:39:15.578915 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f9fc4d9541d44465923f8227cd999f4d&name=default HTTP/1.1" status: 200 len: 2975 time: 0.2868893 May 26 14:39:15.582076 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37158) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:39:15.588498 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.589092 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.589651 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.590210 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.590795 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.591352 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.591913 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.592472 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.593088 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.593643 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.594199 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.594790 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.601297 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:39:15.646740 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:15.673007 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:15.774132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:15.778145 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:39:15.789319 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07db47f4-6193-4e72-a7fd-aca45a1a8d41,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:39:15.798969 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:15.800164 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/07db47f4-6193-4e72-a7fd-aca45a1a8d41 HTTP/1.1" status: 204 len: 168 time: 0.2170019 May 26 14:39:15.801613 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.801960 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.802619 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.802758 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.803069 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.803345 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.803713 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.804029 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.804309 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.804612 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.804940 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.805191 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:39:15.811108 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:39:17.204842 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:39:21.603977 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-345f17f3-b688-4f76-b9e2-e810efece3e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:23.254922 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-44435db7-cb80-4c1a-9d5e-6a685e1af496 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:24.525098 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:25.857138 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:27.410933 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:51.599307 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1639cfb0-8b39-49a6-ad5a-aeb0901749bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:53.248877 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-fce15b28-7678-4717-b38c-a8eba2cf712e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:54.205159 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:39:54.524077 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:55.860682 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:39:57.420326 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:21.603128 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e93cc697-fcfb-41e9-9364-20b4c9890bf7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:23.253124 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-768b6937-760a-41fe-975e-ca0013c63992 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:24.520370 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:25.865533 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:27.416029 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:31.206066 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 5 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:40:51.608682 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7c01bd62-ba67-4bfb-b345-5bd190136e59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:53.261787 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8e1483fe-8b79-4f92-956a-c8a441b09cb5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:53.783854 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135'] for agent, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:54.525374 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:55.875965 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:40:57.419820 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:08.206646 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:41:08.966117 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37232) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:41:09.081218 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5fd3338e-97a4-4168-9666-45a8730d7109 admin admin] 10.222.0.72 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.1139548 May 26 14:41:11.234570 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37242) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:41:11.296657 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-6a0f122b-8192-4a6e-9ea4-767442408490 admin admin] 10.222.0.72 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0606885 May 26 14:41:21.622086 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8adfb728-7c57-4bf4-a240-4038ccf8a963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:23.255164 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a24b311b-9804-4764-874e-1f401203f69a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:23.768915 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:24.529982 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:25.868983 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:27.421737 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:45.206675 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:41:51.618354 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-27a89e5d-c78c-4ac5-a04a-b29f8501cb1a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:53.259866 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c36089cb-e0c7-4a3c-8be1-cafe41fd1ec6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:53.767093 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:54.534827 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:55.880562 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:41:57.425145 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:21.623243 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f5f1f5c5-bb5f-4025-98bc-e0b30fda8aee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:22.207620 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:42:23.266540 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-9531f8fa-b3df-4a53-8146-7da1ca8f2b2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:23.781990 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:24.539024 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:25.880525 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:27.431394 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:38.611180 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37350) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:38.876625 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1067061457-network', 'tenant_id': '1fc4973481d741b79e67299e67b093ee'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:38.882802 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:38.887523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Usage tracker for resource:network and tenant:1fc4973481d741b79e67299e67b093ee is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:38.890778 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:38.897785 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:38.913985 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Made reservation on behalf of 1fc4973481d741b79e67299e67b093ee for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:38.916758 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:38.933502 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:38.949304 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:38.953433 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Usage tracker for resource:security_group_rule and tenant:1fc4973481d741b79e67299e67b093ee is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:38.956360 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:38.962472 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:39.062334 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.067082 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.072210 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:39.109963 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1102} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:42:39.115541 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=faeb384d-f2db-4840-928b-715aac9f2850,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:39.124747 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.125102 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.125431 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.125925 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.126418 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.127221 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.128130 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.128594 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.129323 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.129797 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.130288 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.130677 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Tracked resource versions report: May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: pushed versions: May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: { 'AddressGroup': {'1.2'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'ConntrackHelper': {'1.0'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Log': {'1.0'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Network': {'1.1'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Port': {'1.7'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'PortForwarding': {'1.2'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'QosPolicy': {'1.8'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SecurityGroup': {'1.4'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SecurityGroupRule': {'1.2'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SubPort': {'1.0'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Subnet': {'1.1'}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Trunk': {'1.1'}} May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: consumer versions: May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: { DHCP agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: HyperV agent@hv-cinder-77459: {}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: L3 agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: Metadata agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: Metering agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: Open vSwitch agent@dv-cinder-774594-6-iscsi: { 'AddressGroup': '1.2', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'ConntrackHelper': '1.0', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Log': '1.0', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Network': '1.1', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Port': '1.7', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'PortForwarding': '1.2', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'QosPolicy': '1.8', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SecurityGroup': '1.4', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SecurityGroupRule': '1.2', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'SubPort': '1.0', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Subnet': '1.1', May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: 'Trunk': '1.1'}} May 26 14:42:39.131605 dv-cinder-774594-6-iscsi neutron-server[98444]: {{(pid=98444) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 26 14:42:39.134986 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:39.140375 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.141116 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Added segment c6d04da8-72e4-4a4d-b287-ed73ffe66489 of type vlan for network 5ff5635c-3c40-456e-a3ae-92b893fbd6c8 May 26 14:42:39.170336 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.213036 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.215329 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:39.216350 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.221428 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5c289e23-cb05-48ff-9281-0c9cc13006be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:39.326434 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 0.7125921 May 26 14:42:39.329254 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37400) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:39.338329 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Request body: {'subnet': {'network_id': '5ff5635c-3c40-456e-a3ae-92b893fbd6c8', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1067061457-subnet', 'tenant_id': '1fc4973481d741b79e67299e67b093ee', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:39.341336 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Pushing event updated for resources: {'Network': ['ID=5ff5635c-3c40-456e-a3ae-92b893fbd6c8,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:39.344738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:39.345694 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:39.349711 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Usage tracker for resource:subnet and tenant:1fc4973481d741b79e67299e67b093ee is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:39.352822 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:39.354193 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 5ff5635c-3c40-456e-a3ae-92b893fbd6c8 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:42:39.359051 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:39.373370 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Made reservation on behalf of 1fc4973481d741b79e67299e67b093ee for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:39.375868 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.770607 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.776280 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1cf4f56f-0860-4e73-89e2-80d9e09ca4dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:39.890041 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Checking segment: {'id': 'c6d04da8-72e4-4a4d-b287-ed73ffe66489', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1102, 'network_id': '5ff5635c-3c40-456e-a3ae-92b893fbd6c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:39.890408 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Network hostable DHCP agents. Network: 5ff5635c-3c40-456e-a3ae-92b893fbd6c8, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:42:39.895844 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f287ce92-e839-4b93-991d-1c6b93f3754e,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:39.905921 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:39.913691 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Network 5ff5635c-3c40-456e-a3ae-92b893fbd6c8 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:42:39.924571 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 5ff5635c-3c40-456e-a3ae-92b893fbd6c8) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:39.926390 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37430) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:39.929693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:39.930576 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:39.937668 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df127e8d-2b23-4610-bc91-c92e43afcf1c None None] Network 5ff5635c-3c40-456e-a3ae-92b893fbd6c8 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:39.964820 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.6339633 May 26 14:42:40.142841 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39002e5c-ba54-4539-809c-c5971f676522 None None] Network 5ff5635c-3c40-456e-a3ae-92b893fbd6c8 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:40.235365 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-189466523-network', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:40.241005 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:40.246538 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Usage tracker for resource:network and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:40.250160 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:40.257061 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:40.273182 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Made reservation on behalf of f2b58b2245f643ac9193934fdab405c5 for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:40.278189 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.298419 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.314703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:40.319624 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Usage tracker for resource:security_group_rule and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:40.322816 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:40.329729 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:40.335855 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37456) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:40.385223 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37464) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:40.431161 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.436048 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.440510 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:40.465709 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1101} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:42:40.478175 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0693f589-ba60-4fe9-96d3-11b4d5fa2efd,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:40.488564 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.488920 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Added segment 75b3edd7-3613-43c2-a8ac-684a11f6e11f of type vlan for network dcbc30ab-336e-46b8-a284-99efba24886a May 26 14:42:40.499536 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.499869 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.500194 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.500518 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.500839 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.501169 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.501487 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.501984 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.502344 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.502717 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.502958 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.503266 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Tracked resource versions report: May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: pushed versions: May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: { 'AddressGroup': {'1.2'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'ConntrackHelper': {'1.0'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Log': {'1.0'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Network': {'1.1'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Port': {'1.7'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'PortForwarding': {'1.2'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'QosPolicy': {'1.8'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SecurityGroup': {'1.4'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SecurityGroupRule': {'1.2'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SubPort': {'1.0'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Subnet': {'1.1'}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Trunk': {'1.1'}} May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: consumer versions: May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: { DHCP agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: HyperV agent@hv-cinder-77459: {}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: L3 agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: Metadata agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: Metering agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: Open vSwitch agent@dv-cinder-774594-6-iscsi: { 'AddressGroup': '1.2', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'ConntrackHelper': '1.0', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Log': '1.0', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Network': '1.1', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Port': '1.7', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'PortForwarding': '1.2', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'QosPolicy': '1.8', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SecurityGroup': '1.4', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SecurityGroupRule': '1.2', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'SubPort': '1.0', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Subnet': '1.1', May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: 'Trunk': '1.1'}} May 26 14:42:40.504250 dv-cinder-774594-6-iscsi neutron-server[98445]: {{(pid=98445) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 26 14:42:40.526181 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.532581 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:40.558961 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.560357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:40.561115 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.576128 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1e7e4181-b89c-4515-aa93-3e4254cef87e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:40.651283 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.7236075 May 26 14:42:40.655283 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37478) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:40.664228 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Request body: {'subnet': {'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-subnet', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:40.669416 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:40.673713 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Usage tracker for resource:subnet and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:40.673848 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Pushing event updated for resources: {'Network': ['ID=dcbc30ab-336e-46b8-a284-99efba24886a,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:40.676699 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:40.678543 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:40.684352 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network dcbc30ab-336e-46b8-a284-99efba24886a details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:42:40.686229 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:40.698880 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Made reservation on behalf of f2b58b2245f643ac9193934fdab405c5 for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:40.702193 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.817694 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1237265907-network', 'tenant_id': '57f47a57c1814dd283e52c17dfcb8649'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:40.823417 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:40.829997 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Usage tracker for resource:network and tenant:57f47a57c1814dd283e52c17dfcb8649 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:40.834263 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:40.841430 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:40.889107 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Made reservation on behalf of 57f47a57c1814dd283e52c17dfcb8649 for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:40.896078 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.912098 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-79229929-network', 'tenant_id': '3159eb22d2eb468e967fa04761ae0331'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:40.920685 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:40.932005 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37488) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:40.941172 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:40.941473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37492) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:40.946932 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:40.952158 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Usage tracker for resource:security_group_rule and tenant:57f47a57c1814dd283e52c17dfcb8649 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:40.959123 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:40.972142 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Usage tracker for resource:network and tenant:3159eb22d2eb468e967fa04761ae0331 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:40.983777 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:40.984466 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.003703 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.043898 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Made reservation on behalf of 3159eb22d2eb468e967fa04761ae0331 for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:41.046163 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.064787 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.148408 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:41.157818 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Usage tracker for resource:security_group_rule and tenant:3159eb22d2eb468e967fa04761ae0331 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:41.162618 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:41.174007 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.219301 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-45717524-network', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:41.224553 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:41.229097 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Usage tracker for resource:network and tenant:ff8cee98b9cc47dd9a86993218bdede9 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:41.232949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:41.239897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.256066 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1046636222-network', 'tenant_id': 'c906c656a3474e64ab918724c042f2be'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:41.261976 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:41.267619 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Usage tracker for resource:network and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:41.269851 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.270812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:41.278545 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.280805 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.283719 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Made reservation on behalf of ff8cee98b9cc47dd9a86993218bdede9 for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:41.286902 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.302016 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.307012 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:41.319753 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:41.323850 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Usage tracker for resource:security_group_rule and tenant:ff8cee98b9cc47dd9a86993218bdede9 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:41.326984 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:41.333997 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.361580 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1132} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:42:41.400784 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ecb5754d-a6d1-43a1-82d0-25cec65d5699,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:41.405162 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:41.406443 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.406779 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Added segment 3932bf42-877e-4f90-8f96-afdb4108b51c of type vlan for network 49db6557-68a4-49ce-b847-46383a000b41 May 26 14:42:41.410223 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.439091 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.446393 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.452863 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.454284 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5cb73082-4681-4c97-b619-db96cf4f7122 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:41.465503 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Made reservation on behalf of c906c656a3474e64ab918724c042f2be for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:41.467868 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.474606 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:41.500733 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=549dea61-4498-4c30-b369-c50278775a2e,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:41.505513 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.517873 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:41.525000 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1145} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:42:41.525640 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.540718 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6654faba-95a7-41f7-8376-aad28218a94c,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:41.544207 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:41.548094 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.559534 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1112} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:42:41.564788 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.565321 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Added segment 663227a3-9a48-4112-a25f-e542d7087a84 of type vlan for network c6d63b53-7bae-4cfb-ac0b-4643c0894395 May 26 14:42:41.567179 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:41.569942 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:41.577374 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Usage tracker for resource:security_group_rule and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:41.581744 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:41.590015 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.590855 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Added segment 31f0bd82-c79b-40bf-8404-580a8d30b406 of type vlan for network d130e7f3-8552-49d7-bcfd-3db8c3289227 May 26 14:42:41.592677 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.638278 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.641738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.659708 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:41.660187 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.679704 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=74523655-70dc-48f8-8616-d6b84cac2d6d,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:41.683470 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:41.693440 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:41.704996 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.707401 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:41.708570 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.718996 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.744281 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:41.765706 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 0.8326261 May 26 14:42:41.769566 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37530) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:41.831070 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Checking segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:41.831559 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Network hostable DHCP agents. Network: dcbc30ab-336e-46b8-a284-99efba24886a, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:42:41.844068 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37534) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:41.848139 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Request body: {'subnet': {'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-subnet', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:41.853169 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:41.857886 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Usage tracker for resource:subnet and tenant:ff8cee98b9cc47dd9a86993218bdede9 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:41.860997 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:41.867559 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.883152 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Pushing event updated for resources: {'Network': ['ID=49db6557-68a4-49ce-b847-46383a000b41,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:41.890469 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:41.895367 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.5582814 May 26 14:42:41.896254 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37540) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:41.896391 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 49db6557-68a4-49ce-b847-46383a000b41 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:42:41.897125 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1569725431-network', 'tenant_id': '590c2b74d72440f8931888139e8d8ffc'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:41.902383 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.907263 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:41.907798 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Request body: {'subnet': {'network_id': '49db6557-68a4-49ce-b847-46383a000b41', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1237265907-subnet', 'tenant_id': '57f47a57c1814dd283e52c17dfcb8649', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:41.912533 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Usage tracker for resource:network and tenant:590c2b74d72440f8931888139e8d8ffc is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:41.915666 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:41.916698 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:41.918233 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.921138 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:41.921717 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.925231 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:41.927789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Usage tracker for resource:subnet and tenant:57f47a57c1814dd283e52c17dfcb8649 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:41.930595 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:41.945192 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Pushing event updated for resources: {'Network': ['ID=d130e7f3-8552-49d7-bcfd-3db8c3289227,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:41.949488 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:41.967797 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.968910 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Made reservation on behalf of 590c2b74d72440f8931888139e8d8ffc for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:41.970774 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Network dcbc30ab-336e-46b8-a284-99efba24886a is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:42:41.972125 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:41.999473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:42.000550 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:42.002550 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.036222 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Made reservation on behalf of ff8cee98b9cc47dd9a86993218bdede9 for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:42.039233 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Notify callbacks [] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.056594 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network d130e7f3-8552-49d7-bcfd-3db8c3289227 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:42:42.177174 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.7902398 May 26 14:42:42.177450 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37548) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:42.188555 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, dcbc30ab-336e-46b8-a284-99efba24886a) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:42.212092 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:42.215730 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.221160 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2da9fb09-5c91-4945-b882-6437976b3235 None None] Network dcbc30ab-336e-46b8-a284-99efba24886a requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:42.268002 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Pushing event updated for resources: {'Network': ['ID=c6d63b53-7bae-4cfb-ac0b-4643c0894395,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:42.275964 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:42.277128 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Made reservation on behalf of 57f47a57c1814dd283e52c17dfcb8649 for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:42.279489 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.292838 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network c6d63b53-7bae-4cfb-ac0b-4643c0894395 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:42:42.356422 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1134} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:42:42.377856 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.378873 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Request body: {'subnet': {'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-79229929-subnet', 'tenant_id': '3159eb22d2eb468e967fa04761ae0331', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:42.383439 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Added segment 567291f9-aa99-493c-b4d7-e95dc1f1b3f2 of type vlan for network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 May 26 14:42:42.386406 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.7289302 May 26 14:42:42.391810 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37562) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:42.394881 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:42.405340 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:42.412666 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:42.415751 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Usage tracker for resource:subnet and tenant:3159eb22d2eb468e967fa04761ae0331 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:42.423300 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:42.432108 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.435920 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Usage tracker for resource:router and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:42.445529 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:42.448319 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:42.448866 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:42.456424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:42.461303 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:42.483078 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Made reservation on behalf of 3159eb22d2eb468e967fa04761ae0331 for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:42.485381 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Notify callbacks [] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.508975 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.510267 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.526912 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Usage tracker for resource:security_group_rule and tenant:590c2b74d72440f8931888139e8d8ffc is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:42.564618 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:42.578713 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e764c521-910b-4b8a-9e11-bf5a82e0036b,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:42.590297 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:42.592517 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:42.678070 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.692638 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-dcbc30ab-336e-46b8-a284-99efba24886a', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:42:42.693605 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.805685 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.813938 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:42.814509 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:42.825645 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:42.976667 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Allocated IP 172.20.0.2 (dcbc30ab-336e-46b8-a284-99efba24886a/74523655-70dc-48f8-8616-d6b84cac2d6d/c00b3d7e-6f66-4f33-8706-fcd66f08b8e4) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:43.090524 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Pushing event updated for resources: {'Network': ['ID=82f940d8-9b5b-4a1a-9b79-05f05dbfa116,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:43.113653 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:42:43.123973 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 2.1808221 May 26 14:42:43.125081 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:43.125655 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37580) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:43.173241 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37582) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:43.188510 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.194205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Request body: {'subnet': {'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1046636222-subnet', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:43.200237 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.203298 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:43.223564 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1105} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:42:43.235998 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.236482 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Added segment 48ef654d-19c3-432a-823f-fd85aa7fd8fc of type vlan for network 1662a3c8-db0a-46a8-a9d3-ca1001e3d42e May 26 14:42:43.279095 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Usage tracker for resource:subnet and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:43.282568 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:43.289592 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:43.299020 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:43.380170 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Made reservation on behalf of c906c656a3474e64ab918724c042f2be for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:43.383472 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.393544 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.409563 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Transition to ACTIVE for port object c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:42:43.426690 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.467427 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Transition to ACTIVE for port object c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:42:43.473796 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.479531 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.494514 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:43.510725 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.546704 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.559488 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:43.560222 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.598501 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Network dcbc30ab-336e-46b8-a284-99efba24886a is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:43.601559 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:43.605786 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:42:43.607169 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 1.7271845 May 26 14:42:43.608600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33070503-2222-49ab-b18c-c97084c35c8e,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:43.612103 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37600) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:43.615539 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Pushing event updated for resources: {'Port': ['ID=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:43.618269 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:43.621651 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.067s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:43.664036 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.664758 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.665361 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.665852 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.666433 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.667025 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.667716 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.668220 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.668726 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.669206 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.669845 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.670372 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Tracked resource versions report: May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: pushed versions: May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: { 'AddressGroup': {'1.2'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'ConntrackHelper': {'1.0'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Log': {'1.0'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Network': {'1.1'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Port': {'1.7'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'PortForwarding': {'1.2'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'QosPolicy': {'1.8'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SecurityGroup': {'1.4'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SecurityGroupRule': {'1.2'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SubPort': {'1.0'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Subnet': {'1.1'}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Trunk': {'1.1'}} May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: consumer versions: May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: { DHCP agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: HyperV agent@hv-cinder-77459: {}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: L3 agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: Metadata agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: Metering agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: Open vSwitch agent@dv-cinder-774594-6-iscsi: { 'AddressGroup': '1.2', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'ConntrackHelper': '1.0', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Log': '1.0', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Network': '1.1', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Port': '1.7', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'PortForwarding': '1.2', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'QosPolicy': '1.8', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SecurityGroup': '1.4', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SecurityGroupRule': '1.2', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'SubPort': '1.0', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Subnet': '1.1', May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: 'Trunk': '1.1'}} May 26 14:42:43.671565 dv-cinder-774594-6-iscsi neutron-server[98446]: {{(pid=98446) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 26 14:42:43.702291 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Request body: {'subnet': {'network_id': '1662a3c8-db0a-46a8-a9d3-ca1001e3d42e', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1569725431-subnet', 'tenant_id': '590c2b74d72440f8931888139e8d8ffc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:43.704912 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:43.712240 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Pushing event updated for resources: {'Subnet': ['ID=f9aad151-b793-4393-be42-7258cba2d2e6,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:43.715614 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:43.722143 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.736750 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Attempting to bind port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:42:43.737430 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Attempting to bind port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:42:43.738446 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Attempting to bind port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 on network dcbc30ab-336e-46b8-a284-99efba24886a {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:42:43.745331 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:42:43.746162 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Checking segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:43.746770 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.747320 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Bound using segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:42:43.748187 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Bound port: c00b3d7e-6f66-4f33-8706-fcd66f08b8e4, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:42:43.748873 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.754256 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Usage tracker for resource:subnet and tenant:590c2b74d72440f8931888139e8d8ffc is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:43.756437 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:43.760656 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:43.762376 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.176s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:43.764611 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Usage tracker for resource:security_group_rule and tenant:5342567bdd8749cfbb8a45731ce57c1f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:43.767516 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:43.773271 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:43.857790 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] For port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:42:43.862073 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] For port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:42:43.867609 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:43.869442 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.871209 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Pushing event updated for resources: {'Network': ['ID=1662a3c8-db0a-46a8-a9d3-ca1001e3d42e,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:43.874892 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:43.884955 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:43.887217 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:43.890469 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Checking segment: {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:43.891066 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Network hostable DHCP agents. Network: d130e7f3-8552-49d7-bcfd-3db8c3289227, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:42:43.913114 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.927123 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Network d130e7f3-8552-49d7-bcfd-3db8c3289227 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:42:43.934339 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Made reservation on behalf of 590c2b74d72440f8931888139e8d8ffc for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:43.936842 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:43.943644 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-83a0293a-34b1-4185-8ced-3c890c59f4e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:43.955711 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Pushing event updated for resources: {'Port': ['ID=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:43.958738 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 1662a3c8-db0a-46a8-a9d3-ca1001e3d42e details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:42:44.022788 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Pushing event updated for resources: {'Subnet': ['ID=20c9d993-accf-4e4f-9a65-8f9e0b42e9b4,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:44.030964 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:44.096745 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:44.112418 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Checking segment: {'id': '3932bf42-877e-4f90-8f96-afdb4108b51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1132, 'network_id': '49db6557-68a4-49ce-b847-46383a000b41'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:44.112806 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Network hostable DHCP agents. Network: 49db6557-68a4-49ce-b847-46383a000b41, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:42:44.159451 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, d130e7f3-8552-49d7-bcfd-3db8c3289227) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:44.160947 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.172882 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bfcd97c-2ee1-45ff-bdd3-acd82621b188 None None] Network d130e7f3-8552-49d7-bcfd-3db8c3289227 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:44.177665 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:44.178269 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.254908 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 2.4798000 May 26 14:42:44.257190 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37620) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:44.272961 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:44.292312 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:44.302694 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Usage tracker for resource:router and tenant:ff8cee98b9cc47dd9a86993218bdede9 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:44.307549 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:44.329775 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:44.343013 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Network 49db6557-68a4-49ce-b847-46383a000b41 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:42:44.349167 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.377383 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 49db6557-68a4-49ce-b847-46383a000b41) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:44.402582 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:44.402816 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.403791 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.416243 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29fde111-2de1-4371-a58c-f4dbee6a3403 None None] Network 49db6557-68a4-49ce-b847-46383a000b41 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:44.437822 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:44.438518 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.496164 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.503443 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c79ff44-1089-4ff7-96d8-16624f119e0a,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:44.531454 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:44.565613 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-bff47546-a797-4ede-8f12-6cde12721760 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.6646256 May 26 14:42:44.575401 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Synchronizing usage tracker for tenant:bab17c90a527485280af59f2ebc453a8 on resource:security_group {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:42:44.607022 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.610558 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e621ad6-06b4-4ce3-a62f-d26b439453f1 None None] Network d130e7f3-8552-49d7-bcfd-3db8c3289227 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:44.688680 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.713757 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:44.716433 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Unset dirty status for tenant:bab17c90a527485280af59f2ebc453a8 on resource:security_group {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:42:44.721605 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=5342567bdd8749cfbb8a45731ce57c1f&name=default HTTP/1.1" status: 200 len: 2975 time: 1.5471706 May 26 14:42:44.764549 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37636) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:44.826636 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-364c6c86-365d-4670-b222-816c4b2c21e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:45.013704 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Pushing event updated for resources: {'Subnet': ['ID=e482f08e-dc41-4d58-b9cf-6de9798b0585,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:45.017326 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:45.053384 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-327f3fe6-1971-430a-bb59-e8785c31696a None None] Network 49db6557-68a4-49ce-b847-46383a000b41 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:45.063429 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Checking segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:45.064051 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Network hostable DHCP agents. Network: c6d63b53-7bae-4cfb-ac0b-4643c0894395, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:42:45.070514 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Allocated IP 172.27.3.40 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/b46a2445-80ec-49e7-aadf-1bb3c6e9b455) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:45.106466 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.119004 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Network c6d63b53-7bae-4cfb-ac0b-4643c0894395 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:42:45.137082 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, c6d63b53-7bae-4cfb-ac0b-4643c0894395) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:45.141825 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:45.143147 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.154618 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c16f9b6a-7197-452b-9269-c3b96143762a None None] Network c6d63b53-7bae-4cfb-ac0b-4643c0894395 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:45.261585 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37662) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:45.275842 dv-cinder-774594-6-iscsi neutron-server[98445]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 26 14:42:45.310211 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8c11089b-d0d0-4382-a21c-aa449d38faeb admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 3.1189997 May 26 14:42:45.408338 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.461344 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.466793 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-475f55da-f1a1-4f44-bd02-1dc14d01ba33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:45.486357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6fbfc8b4-ad9d-4cc4-b959-14e8d9b5903d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.531234 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.553449 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8978e0b4-e544-4874-b39d-312ab329df9c None None] Network c6d63b53-7bae-4cfb-ac0b-4643c0894395 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:45.602900 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:45.605878 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:45.610732 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:42:45.634003 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6fbfc8b4-ad9d-4cc4-b959-14e8d9b5903d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.727787 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.732591 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:45.753902 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:42:45.758904 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Pushing event updated for resources: {'Port': ['ID=b46a2445-80ec-49e7-aadf-1bb3c6e9b455,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:45.774492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:45.775335 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6fbfc8b4-ad9d-4cc4-b959-14e8d9b5903d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.896748 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-869236a8-8b37-45ae-b162-6e1dc5962a1e None None] Network dcbc30ab-336e-46b8-a284-99efba24886a requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:45.914964 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6fbfc8b4-ad9d-4cc4-b959-14e8d9b5903d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:45.919305 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6fbfc8b4-ad9d-4cc4-b959-14e8d9b5903d admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/7c79ff44-1089-4ff7-96d8-16624f119e0a HTTP/1.1" status: 204 len: 168 time: 1.1479163 May 26 14:42:45.919305 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Pushing event updated for resources: {'Subnet': ['ID=71bf31f7-84c7-456c-b5a5-f597836f6dc8,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:45.927886 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37690) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:46.038001 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-0dae03dd-722c-4866-bea8-03e6371ac147 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:46.046633 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-0dae03dd-722c-4866-bea8-03e6371ac147 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/networks?id=49db6557-68a4-49ce-b847-46383a000b41 HTTP/1.1" status: 200 len: 812 time: 0.7786515 May 26 14:42:46.063188 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] Provisioning for port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:42:46.066268 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:42:46.075688 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:46.076515 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.105990 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] Provisioning complete for port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:46.106920 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.116878 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.211717 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:46.221809 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Checking segment: {'id': '48ef654d-19c3-432a-823f-fd85aa7fd8fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1105, 'network_id': '1662a3c8-db0a-46a8-a9d3-ca1001e3d42e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:46.222184 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Network hostable DHCP agents. Network: 1662a3c8-db0a-46a8-a9d3-ca1001e3d42e, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:42:46.231954 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.499s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:46.233123 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.386s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:46.233402 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:46.244255 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c5a78a0a-3808-4c8e-b1ea-21d12facfe11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.378s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:46.251842 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-6e5bbe89-16e8-45fd-a47d-1d863012cce2 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/quotas/57f47a57c1814dd283e52c17dfcb8649 HTTP/1.1" status: 200 len: 375 time: 0.2043865 May 26 14:42:46.276245 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fbfc8b4-ad9d-4cc4-b959-14e8d9b5903d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c79ff44-1089-4ff7-96d8-16624f119e0a,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:46.309738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37702) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:46.318474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6fbfc8b4-ad9d-4cc4-b959-14e8d9b5903d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:46.325228 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-bf0b57c2-e714-4701-9a9c-d13721afc2ec tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:46.326735 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-bf0b57c2-e714-4701-9a9c-d13721afc2ec tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 813 time: 0.3612618 May 26 14:42:46.329098 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Checking segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:46.329425 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Network hostable DHCP agents. Network: 82f940d8-9b5b-4a1a-9b79-05f05dbfa116, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:42:46.353185 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-d91b2831-634b-4f74-a666-3d5cc88cdf38 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=57f47a57c1814dd283e52c17dfcb8649&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0880935 May 26 14:42:46.369207 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Network 1662a3c8-db0a-46a8-a9d3-ca1001e3d42e is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:42:46.376484 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-a4dc5f9e-d752-46c1-8db2-fdcbf79ecb25 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/quotas/3159eb22d2eb468e967fa04761ae0331 HTTP/1.1" status: 200 len: 375 time: 0.0297754 May 26 14:42:46.403305 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.445474 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:46.453601 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Usage tracker for resource:security_group_rule and tenant:fda799808e924d988983de652be6260a is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:46.461527 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:46.485701 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 1662a3c8-db0a-46a8-a9d3-ca1001e3d42e) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:46.489601 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.505528 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b02614f-1606-4a04-8832-04c577f1c027 None None] Network 1662a3c8-db0a-46a8-a9d3-ca1001e3d42e requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:46.538357 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:46.553387 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-48b7b22d-089d-4a6f-a3e5-8c5f3b4a9542 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1681702 May 26 14:42:46.554593 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:46.555171 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.568417 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:42:46.615325 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.618487 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 82f940d8-9b5b-4a1a-9b79-05f05dbfa116) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:46.638351 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-de5566ae-c0a4-470c-ab83-830bcfebf112 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 3.0089078 May 26 14:42:46.638351 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:46.638351 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.663535 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16616c28-cee3-4c6c-8ee3-30d60c1668e2 None None] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:46.677903 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.688246 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.721515 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] For port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:42:46.755576 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-bbf41658-e319-4d33-8cc8-6d5b0c5d8295 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:42:46.756659 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-bbf41658-e319-4d33-8cc8-6d5b0c5d8295 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.2148864 May 26 14:42:46.765292 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-087cf449-4ee6-4c90-a648-509236c30242 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:42:46.772731 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-087cf449-4ee6-4c90-a648-509236c30242 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1122236 May 26 14:42:46.866525 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.877100 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.896432 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f1e3ba1d-3520-4095-be44-f0e71912373d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:46.907670 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.908948 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:46.911159 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37724) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:46.915519 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-27772813-7dd5-4339-8b18-8f69c83eface service neutron] 10.222.0.72 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1413784 May 26 14:42:46.917610 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 3.7781327 May 26 14:42:46.938136 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37728) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:46.947199 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:47.001794 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0b09c7a-22ec-4dd3-a5ef-62e05f9dd0e6,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:47.004717 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:47.005347 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:47.009133 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:47.013009 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Usage tracker for resource:router and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:47.014677 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=fda799808e924d988983de652be6260a&name=default HTTP/1.1" status: 200 len: 2976 time: 0.7033250 May 26 14:42:47.015035 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37732) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:47.016070 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:47.019692 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Router f62ef884-b65a-487d-8955-15d95245398f is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98444) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:42:47.021895 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:47.048312 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Deleting subnet f287ce92-e839-4b93-991d-1c6b93f3754e {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:42:47.049622 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:42:47.050492 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.068224 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.134124 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] Pushing event updated for resources: {'Port': ['ID=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:47.149712 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:47.236673 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.238107 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.253935 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a614536-a887-41ce-a794-13743402b026 None None] Network 1662a3c8-db0a-46a8-a9d3-ca1001e3d42e requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:47.290037 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.db.api [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=98446) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 26 14:42:47.290455 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_db.api [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 26 14:42:47.335498 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.359205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.401156 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.429666 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-983d52dc-47d6-43b5-a7be-47393fbc7ec4 service neutron] 10.222.0.72 "GET /v2.0/networks/49db6557-68a4-49ce-b847-46383a000b41?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6547523 May 26 14:42:47.442505 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bc148b57-4fb8-4e16-9ad2-3b5b91a3065d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.443212 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-008252c5-2e4d-469f-961a-fc6fc3c9fbc1 service neutron] 10.222.0.72 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5227852 May 26 14:42:47.444563 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Allocated IP 172.27.3.211 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/d716edee-1b42-40f1-9df5-42382e808d45) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:47.467483 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-1bce6c33-6f22-4b47-bda6-2080026766ce None None] Provisioning complete for port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:47.467865 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1bce6c33-6f22-4b47-bda6-2080026766ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.529846 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bc148b57-4fb8-4e16-9ad2-3b5b91a3065d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.609309 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:42:47.621692 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Sync routers for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:42:47.644965 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:42:47.645632 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:47.691943 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.693555 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 5.3007402 May 26 14:42:47.696401 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37746) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:47.747988 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Allocated IP 172.20.0.2 (82f940d8-9b5b-4a1a-9b79-05f05dbfa116/0ff14072-b6ed-4e7e-acdf-9c02d2a054b3/d8bd9445-9a77-4cb4-88c8-49787862e2d2) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:47.888763 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bc148b57-4fb8-4e16-9ad2-3b5b91a3065d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:47.909490 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:47.994775 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc148b57-4fb8-4e16-9ad2-3b5b91a3065d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0b09c7a-22ec-4dd3-a5ef-62e05f9dd0e6,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:48.007431 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bc148b57-4fb8-4e16-9ad2-3b5b91a3065d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:48.044178 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:42:48.053901 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bc148b57-4fb8-4e16-9ad2-3b5b91a3065d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.056957 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-bc148b57-4fb8-4e16-9ad2-3b5b91a3065d admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/f0b09c7a-22ec-4dd3-a5ef-62e05f9dd0e6 HTTP/1.1" status: 204 len: 168 time: 1.0384605 May 26 14:42:48.075154 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-f1a7d5f4-1b67-43a6-9be0-927f307a97db service neutron] 10.222.0.72 "GET /v2.0/networks/49db6557-68a4-49ce-b847-46383a000b41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6340926 May 26 14:42:48.325054 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6c685bff-741d-4a84-95e2-86d027ffd64c req-5d99d288-6e2a-4e63-b1f8-edd0946aec72 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 210 time: 0.2260005 May 26 14:42:48.327599 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.329543 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.386692 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:42:48.391402 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:48.466054 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.520276 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f287ce92-e839-4b93-991d-1c6b93f3754e,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:48.527049 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37776) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:48.545160 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:48.562550 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.599594 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.630324 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Transition to ACTIVE for port object d8bd9445-9a77-4cb4-88c8-49787862e2d2 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:42:48.667380 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:48.667622 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.714085 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-17a61d11-c420-457f-8caa-f4b6c51060f3 req-3d6493af-279d-40d6-b971-9db3ef4bfb7d tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.0915253 May 26 14:42:48.783720 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Transition to ACTIVE for port object d8bd9445-9a77-4cb4-88c8-49787862e2d2 will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:42:48.799498 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.814412 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:48.856228 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:48.877728 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/f287ce92-e839-4b93-991d-1c6b93f3754e HTTP/1.1" status: 204 len: 168 time: 1.9652946 May 26 14:42:48.930510 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37808) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:48.946648 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:48.959447 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:49.010542 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:45Z', 'revision_number': 3, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:49.023056 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:42:49.029797 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Checking router: f62ef884-b65a-487d-8955-15d95245398f for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:42:49.030286 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Updating router f62ef884-b65a-487d-8955-15d95245398f port b46a2445-80ec-49e7-aadf-1bb3c6e9b455 binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:42:49.037104 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:49.054669 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.120084 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:49.130156 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Usage tracker for resource:security_group_rule and tenant:ee403025881b4bf8991d2cf7bb66b743 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:49.140160 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:49.155449 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:49.175850 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.196551 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Pushing event updated for resources: {'Port': ['ID=d8bd9445-9a77-4cb4-88c8-49787862e2d2,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:49.204438 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:49.210745 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:49.212137 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:49.219437 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:42:49.347404 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.376220 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Pushing event updated for resources: {'Port': ['ID=d716edee-1b42-40f1-9df5-42382e808d45,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:49.466712 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.651s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:49.483601 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.490221 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Attempting to bind port d8bd9445-9a77-4cb4-88c8-49787862e2d2 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:42:49.491748 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Attempting to bind port d8bd9445-9a77-4cb4-88c8-49787862e2d2 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:42:49.492119 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Attempting to bind port d8bd9445-9a77-4cb4-88c8-49787862e2d2 on network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:42:49.506398 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:42:49.506781 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Checking segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:49.507192 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.507585 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Bound using segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:42:49.508062 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Bound port: d8bd9445-9a77-4cb4-88c8-49787862e2d2, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:42:49.509885 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.661313 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.675467 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d0890e90-682e-4396-8f07-042f4f515bda req-fc06f7ef-64d4-49f3-b877-29c0e45ba91b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 210 time: 0.2238796 May 26 14:42:49.746136 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] For port d8bd9445-9a77-4cb4-88c8-49787862e2d2, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:42:49.754971 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] For port d8bd9445-9a77-4cb4-88c8-49787862e2d2, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d8bd9445-9a77-4cb4-88c8-49787862e2d2,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:42:49.767604 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.772798 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:49.870085 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Pushing event updated for resources: {'Port': ['ID=d8bd9445-9a77-4cb4-88c8-49787862e2d2,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:49.874445 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:49.918539 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.934883 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Transition to ACTIVE for port object b46a2445-80ec-49e7-aadf-1bb3c6e9b455 will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:42:49.944967 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:49.960505 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:50.080382 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Attempting to bind port b46a2445-80ec-49e7-aadf-1bb3c6e9b455 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:42:50.080382 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Attempting to bind port b46a2445-80ec-49e7-aadf-1bb3c6e9b455 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:42:50.080382 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Attempting to bind port b46a2445-80ec-49e7-aadf-1bb3c6e9b455 on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:42:50.091714 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Pushing event updated for resources: {'Port': ['ID=b46a2445-80ec-49e7-aadf-1bb3c6e9b455,revision_number=2']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:50.094289 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:42:50.095305 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:50.095665 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.096078 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:42:50.097136 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Bound port: b46a2445-80ec-49e7-aadf-1bb3c6e9b455, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:42:50.097360 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.202333 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.204110 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.204601 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.205874 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.207915 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.209915 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.211076 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.212494 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.213061 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.214884 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.215395 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.215890 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Tracked resource versions report: May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: pushed versions: May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: { 'AddressGroup': {'1.2'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'ConntrackHelper': {'1.0'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Log': {'1.0'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Network': {'1.1'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Port': {'1.7'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'PortForwarding': {'1.2'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'QosPolicy': {'1.8'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SecurityGroup': {'1.4'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SecurityGroupRule': {'1.2'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SubPort': {'1.0'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Subnet': {'1.1'}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Trunk': {'1.1'}} May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: consumer versions: May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: { DHCP agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: HyperV agent@hv-cinder-77459: {}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: L3 agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: Metadata agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: Metering agent@dv-cinder-774594-6-iscsi: {}, May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: Open vSwitch agent@dv-cinder-774594-6-iscsi: { 'AddressGroup': '1.2', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'ConntrackHelper': '1.0', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Log': '1.0', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Network': '1.1', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Port': '1.7', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'PortForwarding': '1.2', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'QosPolicy': '1.8', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SecurityGroup': '1.4', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SecurityGroupRule': '1.2', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'SubPort': '1.0', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Subnet': '1.1', May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: 'Trunk': '1.1'}} May 26 14:42:50.219819 dv-cinder-774594-6-iscsi neutron-server[98447]: {{(pid=98447) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 26 14:42:50.246163 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.286s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:50.259661 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cfd955d0-fb99-4b3d-a654-e2f3f2b41122 req-20d73e61-1403-4bcd-ade6-80534ea942ca tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.4346051 May 26 14:42:50.380600 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] For port b46a2445-80ec-49e7-aadf-1bb3c6e9b455, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:42:50.384439 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] For port b46a2445-80ec-49e7-aadf-1bb3c6e9b455, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=b46a2445-80ec-49e7-aadf-1bb3c6e9b455,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:42:50.395597 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.410511 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:50.417003 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d8bd9445-9a77-4cb4-88c8-49787862e2d2 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:42:50.432318 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.487200 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.487446 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.492882 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.493582 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > port after_create 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.493740 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > port after_delete 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.494079 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > port after_update 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.495947 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.496147 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.496480 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:42:50.496602 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.496808 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.497126 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:50.550250 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port d8bd9445-9a77-4cb4-88c8-49787862e2d2 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:42:50.597478 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Pushing event updated for resources: {'Port': ['ID=b46a2445-80ec-49e7-aadf-1bb3c6e9b455,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:50.617796 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:50.623526 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Allocated IP 172.27.3.35 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/878df695-7300-4df7-af49-82e0eea671af) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:50.671378 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.715741 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.716319 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.716544 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.716936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=98444) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:50.717344 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5ff5635c-3c40-456e-a3ae-92b893fbd6c8']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:50.740100 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c6d04da8-72e4-4a4d-b287-ed73ffe66489') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:50.740686 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c6d04da8-72e4-4a4d-b287-ed73ffe66489') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:50.763992 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.858748 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.873571 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:42:50.894329 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Releasing vlan 1102 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:42:50.894771 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: from cryptography.utils import int_from_bytes May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: from cryptography.utils import int_from_bytes May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:42:50.929400 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:42:50.935259 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:50.964423 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.081585 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.125891 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.157820 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:51.173202 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.79', 56532) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:51.223211 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-90c0415d-949e-47e7-8129-49f330410fb4 req-ed4be6c3-6a7d-48fd-9f4e-824af44c0209 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 210 time: 0.1234596 May 26 14:42:51.405295 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-353207a9-218a-4101-bfc9-1e8af9c852ae None None] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:42:51.411325 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.434354 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.509699 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:45Z', 'revision_number': 3, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:51.515808 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a799a7e-02a7-4d3a-88ba-7ee94f1afd67 None None] The sync data for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi is: [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:45Z', 'revision_number': 3, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:42:51.520877 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=ee403025881b4bf8991d2cf7bb66b743&name=default HTTP/1.1" status: 200 len: 2979 time: 2.9821966 May 26 14:42:51.535416 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37890) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:51.553171 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=980bfe97-8e09-4f8a-b116-31fcbeb91540,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:51.581933 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] Provisioning for port d8bd9445-9a77-4cb4-88c8-49787862e2d2 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:42:51.592227 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] Provisioning complete for port d8bd9445-9a77-4cb4-88c8-49787862e2d2 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:51.592877 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.611314 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.455s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:51.611885 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:51.656571 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Pushing event deleted for resources: {'Network': ['ID=5ff5635c-3c40-456e-a3ae-92b893fbd6c8,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:51.679880 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:51.683521 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3a1b8b03-412d-47ef-b73f-24d292a2c06a req-05219468-84a3-4ad6-916d-2daac9050350 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.1178381 May 26 14:42:51.713438 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.745852 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.007s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:51.782914 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.889334 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-115f9934-5ec9-4834-86eb-b481526a3036 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:51.933525 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] 10.222.0.72 "DELETE /v2.0/networks/5ff5635c-3c40-456e-a3ae-92b893fbd6c8 HTTP/1.1" status: 204 len: 168 time: 2.9980922 May 26 14:42:51.947437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37908) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:51.981040 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.79', 56541) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:52.006095 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:52.055438 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] For port d8bd9445-9a77-4cb4-88c8-49787862e2d2, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d8bd9445-9a77-4cb4-88c8-49787862e2d2,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:42:52.063800 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:52.080583 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:52.216871 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:52.229349 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8aaf2820-9c17-4252-836c-b9f8d5c1fa43 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:52.241698 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:52.242264 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-50494c92-0c22-4891-ad00-9b1b6471371b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:52.243101 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-50494c92-0c22-4891-ad00-9b1b6471371b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Synchronizing usage tracker for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:network {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:42:52.250859 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:42:52.369848 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] Pushing event updated for resources: {'Port': ['ID=d8bd9445-9a77-4cb4-88c8-49787862e2d2,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:52.377690 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:52.416908 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device b46a2445-80ec-49e7-aadf-1bb3c6e9b455 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:42:52.482897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Pushing event updated for resources: {'Port': ['ID=878df695-7300-4df7-af49-82e0eea671af,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:52.515719 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.769s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:52.576655 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port b46a2445-80ec-49e7-aadf-1bb3c6e9b455 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:42:52.584830 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port b46a2445-80ec-49e7-aadf-1bb3c6e9b455 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:52.586867 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:52.613437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8aaf2820-9c17-4252-836c-b9f8d5c1fa43 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:52.682525 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-2130f32a-4d1d-46e2-bb34-acc0c38e8a70 None None] Provisioning complete for port d8bd9445-9a77-4cb4-88c8-49787862e2d2 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:52.682917 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-2130f32a-4d1d-46e2-bb34-acc0c38e8a70 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:52.704959 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7acc7c5e-a1d3-48fd-8dde-06d5a285b2d6 req-60cb4e8c-1ad7-4c25-93ea-44b262a41367 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 210 time: 0.1828325 May 26 14:42:52.812650 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-50494c92-0c22-4891-ad00-9b1b6471371b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Unset dirty status for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:network {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:42:52.813935 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-50494c92-0c22-4891-ad00-9b1b6471371b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 813 time: 1.6361027 May 26 14:42:52.824343 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Router 4b252345-f758-472e-99df-5f8be3fcb13a is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98445) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:42:52.824612 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] Deleting subnet 71bf31f7-84c7-456c-b5a5-f597836f6dc8 {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:42:52.895176 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:52.968921 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:52.993398 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:53.067666 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port b46a2445-80ec-49e7-aadf-1bb3c6e9b455, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=b46a2445-80ec-49e7-aadf-1bb3c6e9b455,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:42:53.073974 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:53.078954 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:53.087372 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:53.148488 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Allocated IP 172.20.0.1 (dcbc30ab-336e-46b8-a284-99efba24886a/74523655-70dc-48f8-8616-d6b84cac2d6d/d2621169-995c-464e-b4f1-7f93fa23a183) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:53.158468 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-bf03c9de-6ca8-41ba-b4fa-40ef674310f6 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:53.159684 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-bf03c9de-6ca8-41ba-b4fa-40ef674310f6 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Synchronizing usage tracker for tenant:57f47a57c1814dd283e52c17dfcb8649 on resource:network {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:42:53.188249 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8aaf2820-9c17-4252-836c-b9f8d5c1fa43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:53.292994 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=b46a2445-80ec-49e7-aadf-1bb3c6e9b455,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:53.323768 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-4d457fa5-6d6d-42ea-9350-97f278a684dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:53.327459 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:53.381071 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b93ab831-c0e4-4fe1-8e87-42465e48c53f req-b0510ac4-6fb2-4651-9c2c-5a4ca2d0c9e8 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.4513857 May 26 14:42:53.483774 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:53.502666 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Transition to ACTIVE for port object d2621169-995c-464e-b4f1-7f93fa23a183 will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:42:53.613820 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:53.656718 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Request body: {'port': {'device_id': '75dff9cc-3473-4c96-8f63-78fe18c37cd3', 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'admin_state_up': True, 'tenant_id': '3159eb22d2eb468e967fa04761ae0331'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:53.683814 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:42:53.693336 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Sync routers for ids ['4b252345-f758-472e-99df-5f8be3fcb13a'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:42:53.707786 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8026f976-983e-4167-b47c-34813e3932af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:53.716560 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Routers {'4b252345-f758-472e-99df-5f8be3fcb13a'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:42:53.717174 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4b252345-f758-472e-99df-5f8be3fcb13a'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:53.727151 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:53.731911 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 9.4721582 May 26 14:42:53.732726 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37964) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:54.126478 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:54.187300 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-bf03c9de-6ca8-41ba-b4fa-40ef674310f6 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Unset dirty status for tenant:57f47a57c1814dd283e52c17dfcb8649 on resource:network {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:42:54.188474 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-bf03c9de-6ca8-41ba-b4fa-40ef674310f6 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.79 "GET /v2.0/networks?id=49db6557-68a4-49ce-b847-46383a000b41 HTTP/1.1" status: 200 len: 812 time: 2.1837311 May 26 14:42:54.200150 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:54.201234 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8aaf2820-9c17-4252-836c-b9f8d5c1fa43 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:54.202436 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8aaf2820-9c17-4252-836c-b9f8d5c1fa43 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/980bfe97-8e09-4f8a-b116-31fcbeb91540 HTTP/1.1" status: 204 len: 168 time: 2.6605430 May 26 14:42:54.203578 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aaf2820-9c17-4252-836c-b9f8d5c1fa43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=980bfe97-8e09-4f8a-b116-31fcbeb91540,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:54.216183 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8aaf2820-9c17-4252-836c-b9f8d5c1fa43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.509s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:54.223917 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9255bb8a-36f4-48e8-8b86-05c4cdaa55b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:54.273723 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Request body: {'port': {'device_id': '0d70a460-f327-420d-902a-7e26b59453d5', 'network_id': '49db6557-68a4-49ce-b847-46383a000b41', 'admin_state_up': True, 'tenant_id': '57f47a57c1814dd283e52c17dfcb8649'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:54.278239 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Set router 4b252345-f758-472e-99df-5f8be3fcb13a gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:42:54.487632 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Network dcbc30ab-336e-46b8-a284-99efba24886a is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:54.500525 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:54.533886 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:42:54.584599 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:54.613082 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:54.638572 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d8bd9445-9a77-4cb4-88c8-49787862e2d2 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:42:54.639877 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Pushing event updated for resources: {'Port': ['ID=d2621169-995c-464e-b4f1-7f93fa23a183,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:54.671523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Usage tracker for resource:port and tenant:3159eb22d2eb468e967fa04761ae0331 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:54.685874 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0aa69a23-0594-4bcc-beb9-93dd30017fe8 req-6b8a166b-dad9-48b5-af2f-eb7b34cdfbb8 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 210 time: 0.6440692 May 26 14:42:54.721452 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.499s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:54.722116 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 37982) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:54.723037 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:54.739907 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.065s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:54.859246 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4090f80b-57e9-49a2-86f8-563c71f4f5d0 req-7663c9e2-b51e-4840-9714-61ce50166d23 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.0869884 May 26 14:42:54.877930 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:54.888024 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:54.907545 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:54.943647 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=71bf31f7-84c7-456c-b5a5-f597836f6dc8,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:54.946122 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] 10.222.0.72 "DELETE /v2.0/subnets/71bf31f7-84c7-456c-b5a5-f597836f6dc8 HTTP/1.1" status: 204 len: 168 time: 2.9664540 May 26 14:42:54.950331 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 37988) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:54.972021 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-edae0210-cd05-4034-b018-b6a655e69a0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:55.013901 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Made reservation on behalf of 3159eb22d2eb468e967fa04761ae0331 for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:55.018371 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.049095 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:55.082171 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Usage tracker for resource:port and tenant:57f47a57c1814dd283e52c17dfcb8649 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:55.093060 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:55.128046 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:55.167941 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Made reservation on behalf of 57f47a57c1814dd283e52c17dfcb8649 for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:42:55.183882 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.198427 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.394598 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d8bd9445-9a77-4cb4-88c8-49787862e2d2 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:55.395210 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.457812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.500899 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-30426c16-e67f-4d2d-b260-5a55f8e7bc27 None None] Provisioning for port d2621169-995c-464e-b4f1-7f93fa23a183 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:42:55.550642 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.561176 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-30426c16-e67f-4d2d-b260-5a55f8e7bc27 None None] Provisioning complete for port d2621169-995c-464e-b4f1-7f93fa23a183 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:55.561552 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-30426c16-e67f-4d2d-b260-5a55f8e7bc27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.632488 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Allocated IP 172.20.0.5 (c6d63b53-7bae-4cfb-ac0b-4643c0894395/e482f08e-dc41-4d58-b9cf-6de9798b0585/ec4ee3ea-9d36-4c14-a225-a3445629295c) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:55.636580 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-30426c16-e67f-4d2d-b260-5a55f8e7bc27 None None] Port d2621169-995c-464e-b4f1-7f93fa23a183 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:42:55.682348 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:49Z', 'revision_number': 3, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port': {'id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:21:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:46Z', 'updated_at': '2021-05-26T14:42:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:55.711752 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Checking router: 4b252345-f758-472e-99df-5f8be3fcb13a for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:42:55.712118 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Updating router 4b252345-f758-472e-99df-5f8be3fcb13a port d716edee-1b42-40f1-9df5-42382e808d45 binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:42:55.847137 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device b46a2445-80ec-49e7-aadf-1bb3c6e9b455 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:42:55.922240 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.957254 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.976437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:55.993359 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.029135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:42:56.037551 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.053266 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:56.122654 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Network c6d63b53-7bae-4cfb-ac0b-4643c0894395 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:56.129699 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Usage tracker for resource:security_group_rule and tenant:694a0d846ae74e6fabc08c73f1b95fcb is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:42:56.156125 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:56.171144 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:42:56.176394 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > segment before_delete 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.176728 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.177793 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.178338 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > port after_create 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.178811 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > port after_delete 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.179312 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > port after_update 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.179798 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > segment after_delete 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.180338 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.181129 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.181741 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > subnet after_update 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.185494 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:42:56.247992 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:42:56.440143 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.440511 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.440725 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > subnet before_create 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.441050 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Subscribe: > subnet before_update 55550000 {{(pid=98445) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 26 14:42:56.441680 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1662a3c8-db0a-46a8-a9d3-ca1001e3d42e']}} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:56.503525 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.533225 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:56.539907 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.612869 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '48ef654d-19c3-432a-823f-fd85aa7fd8fc') {'for_net_delete': True} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:56.613130 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '48ef654d-19c3-432a-823f-fd85aa7fd8fc') {} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:56.626745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Pushing event updated for resources: {'Port': ['ID=ec4ee3ea-9d36-4c14-a225-a3445629295c,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:56.642582 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.651295 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.4833643 May 26 14:42:56.658430 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a45339f8-ed02-4523-839b-376127df0368 req-f7fcd9e1-81fb-4b7b-a6de-a3a2059fac00 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.1696098 May 26 14:42:56.680413 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.613s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:56.690973 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2677883'] for segment, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.697302 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port b46a2445-80ec-49e7-aadf-1bb3c6e9b455 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:56.697668 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.770817 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.848662 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Releasing vlan 1105 on physical network physnet1 to pool {{(pid=98445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:42:56.849423 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2334298'] for segment, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: from cryptography.utils import int_from_bytes May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: from cryptography.utils import int_from_bytes May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: Traceback (most recent call last): May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: timer() May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: cb(*args, **kw) May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: return func(*args, **kwargs) May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: self._notify() May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: self.callback(batched_events) May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: event.method(event) May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: return f(self, *a, **k) May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._get(url).json() May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: return self.request(url, 'GET', **kwargs) May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:42:56.875935 dv-cinder-774594-6-iscsi neutron-server[98445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:42:56.894612 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Router 3865f36a-0ff1-4ceb-997f-e7f4306675ef is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98445) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:42:57.020016 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.041433 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.049370 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.066074 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Allocated IP 172.20.0.11 (49db6557-68a4-49ce-b847-46383a000b41/20c9d993-accf-4e4f-9a65-8f9e0b42e9b4/9650b7e0-6b25-419e-8a24-02c267172949) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:57.163390 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fdd716-79d4-4141-b34e-6a38cf1b5efe req-4952e12a-f964-4c8e-b85d-e7d59f7290b3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:57.170911 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c6fdd716-79d4-4141-b34e-6a38cf1b5efe req-4952e12a-f964-4c8e-b85d-e7d59f7290b3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 931 time: 1.1090181 May 26 14:42:57.184928 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:57.190200 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Transition to ACTIVE for port object d716edee-1b42-40f1-9df5-42382e808d45 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:42:57.201732 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.207766 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:57.248834 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.294520 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:57.310459 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.381456 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.393819 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Pushing event deleted for resources: {'Network': ['ID=1662a3c8-db0a-46a8-a9d3-ca1001e3d42e,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:57.408486 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] 10.222.0.72 "DELETE /v2.0/networks/1662a3c8-db0a-46a8-a9d3-ca1001e3d42e HTTP/1.1" status: 204 len: 168 time: 2.3842635 May 26 14:42:57.413880 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Pushing event updated for resources: {'Port': ['ID=d2621169-995c-464e-b4f1-7f93fa23a183,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:57.420064 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c6fdd716-79d4-4141-b34e-6a38cf1b5efe req-feb48697-8564-410b-b3c8-737efe760a7c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2481873 May 26 14:42:57.421225 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d0873096-7f31-48b2-96bb-7bb7d05229fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:57.431743 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:57.434270 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.486478 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Attempting to bind port d716edee-1b42-40f1-9df5-42382e808d45 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:42:57.486845 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Attempting to bind port d716edee-1b42-40f1-9df5-42382e808d45 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:42:57.487687 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Attempting to bind port d716edee-1b42-40f1-9df5-42382e808d45 on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:42:57.509452 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:42:57.524167 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Sync routers for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:42:57.569609 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.569987 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:42:57.570714 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:57.576144 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 10.5866647 May 26 14:42:57.580587 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38028) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:57.628726 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:42:57.629161 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:57.629580 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.629984 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:42:57.630506 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Bound port: d716edee-1b42-40f1-9df5-42382e808d45, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:42:57.630895 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.771025 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.809557 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2845af-2478-4c4e-a33c-fbfe9bf9686f None None] Pushing event updated for resources: {'Port': ['ID=d716edee-1b42-40f1-9df5-42382e808d45,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:57.818418 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-9b2845af-2478-4c4e-a33c-fbfe9bf9686f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.611s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:57.821695 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.866923 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:57.899010 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:57.907590 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38038) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:57.912524 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-3fdf860c-28bf-4283-b3c3-7a2c085647a0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98444) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:42:57.913501 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-3fdf860c-28bf-4283-b3c3-7a2c085647a0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0053518 May 26 14:42:57.999144 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] For port d716edee-1b42-40f1-9df5-42382e808d45, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:42:58.002773 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] For port d716edee-1b42-40f1-9df5-42382e808d45, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d716edee-1b42-40f1-9df5-42382e808d45,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:42:58.007918 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:58.012070 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:58.056784 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:42:58.151722 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=694a0d846ae74e6fabc08c73f1b95fcb&name=default HTTP/1.1" status: 200 len: 2979 time: 3.3505630 May 26 14:42:58.170278 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f81237e-73da-448c-a648-efd28525c431,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:58.172688 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38042) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:58.175389 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Routers {'4b252345-f758-472e-99df-5f8be3fcb13a'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:42:58.176071 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4b252345-f758-472e-99df-5f8be3fcb13a'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:58.229142 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.362s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:58.278514 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2845af-2478-4c4e-a33c-fbfe9bf9686f None None] Pushing event updated for resources: {'Port': ['ID=d716edee-1b42-40f1-9df5-42382e808d45,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:58.284196 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-9b2845af-2478-4c4e-a33c-fbfe9bf9686f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:58.326904 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Network dcbc30ab-336e-46b8-a284-99efba24886a is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:58.340896 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:58.372789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:58.529833 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] Set router 4b252345-f758-472e-99df-5f8be3fcb13a gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:42:58.606553 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Request body: {'port': {'device_id': '75dff9cc-3473-4c96-8f63-78fe18c37cd3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:42:58.643169 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 3, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:42:50Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:58.650928 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Checking router: 3865f36a-0ff1-4ceb-997f-e7f4306675ef for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:42:58.651647 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Updating router 3865f36a-0ff1-4ceb-997f-e7f4306675ef port 878df695-7300-4df7-af49-82e0eea671af binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:42:58.652541 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-96f51ad5-1dc7-400e-af76-07dd881bef4e req-8ea2841c-7d1b-452a-acd1-fd7c896ae258 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.3475220 May 26 14:42:58.686955 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:58.748881 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:58.759457 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:58.788889 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e4703f46-55ad-40c5-ba75-6bd4d5710165 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=1fc4973481d741b79e67299e67b093ee&name=default HTTP/1.1" status: 200 len: 2975 time: 0.8654420 May 26 14:42:58.813199 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38054) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:42:58.988900 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Allocated IP 172.20.0.1 (d130e7f3-8552-49d7-bcfd-3db8c3289227/f9aad151-b793-4393-be42-7258cba2d2e6/0b26b296-28ad-492a-9268-6d6f5e3fb2f1) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:42:59.034249 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-2aab2579-6d9c-427b-b86e-94c80a4abe5c None None] Provisioning complete for port d2621169-995c-464e-b4f1-7f93fa23a183 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:42:59.034776 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-2aab2579-6d9c-427b-b86e-94c80a4abe5c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.129254 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-2aab2579-6d9c-427b-b86e-94c80a4abe5c None None] Port d2621169-995c-464e-b4f1-7f93fa23a183 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:42:59.186749 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Network 49db6557-68a4-49ce-b847-46383a000b41 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:42:59.222125 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:42:59.234119 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:42:59.237198 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:42:59.283152 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.334228 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:49Z', 'revision_number': 3, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port': {'id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:21:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:46Z', 'updated_at': '2021-05-26T14:42:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:42:59.341168 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7098631f-b9df-4edf-a373-e9a4208bc4c5 None None] The sync data for ids ['4b252345-f758-472e-99df-5f8be3fcb13a'] in dv-cinder-774594-6-iscsi is: [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:49Z', 'revision_number': 3, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port': {'id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:21:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:46Z', 'updated_at': '2021-05-26T14:42:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:42:59.413659 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e058a14f-7387-449a-84f5-975ae953c264 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.480610 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.507056 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Transition to ACTIVE for port object 878df695-7300-4df7-af49-82e0eea671af will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:42:59.531027 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.536022 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:42:59.542511 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Pushing event updated for resources: {'Port': ['ID=9650b7e0-6b25-419e-8a24-02c267172949,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:59.568718 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.809s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:42:59.603388 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Router f62ef884-b65a-487d-8955-15d95245398f has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:42:59.657590 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:42:59.658171 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.710557 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c63f85b6-2c5b-43ef-85c1-ab7fd38642c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.884117 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Attempting to bind port 878df695-7300-4df7-af49-82e0eea671af on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:42:59.884117 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Attempting to bind port 878df695-7300-4df7-af49-82e0eea671af by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:42:59.884117 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Attempting to bind port 878df695-7300-4df7-af49-82e0eea671af on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:42:59.893588 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c481b1-c3f1-44d2-a06e-329a66a0ef33 None None] Pushing event updated for resources: {'Port': ['ID=878df695-7300-4df7-af49-82e0eea671af,revision_number=2']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:42:59.931328 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:42:59.931328 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:42:59.931328 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.931328 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:42:59.931328 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Bound port: 878df695-7300-4df7-af49-82e0eea671af, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:42:59.931328 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:42:59.931328 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-c7c481b1-c3f1-44d2-a06e-329a66a0ef33 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.394s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:00.008772 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] For port 878df695-7300-4df7-af49-82e0eea671af, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:00.013038 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] For port 878df695-7300-4df7-af49-82e0eea671af, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=878df695-7300-4df7-af49-82e0eea671af,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:00.025149 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:00.040206 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-c7c481b1-c3f1-44d2-a06e-329a66a0ef33 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:00.335826 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 5.9703856 May 26 14:43:00.337913 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:00.337913 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:00.338105 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c63f85b6-2c5b-43ef-85c1-ab7fd38642c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:00.400435 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c481b1-c3f1-44d2-a06e-329a66a0ef33 None None] Pushing event updated for resources: {'Port': ['ID=878df695-7300-4df7-af49-82e0eea671af,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:00.413982 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-c7c481b1-c3f1-44d2-a06e-329a66a0ef33 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.374s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:00.480537 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e058a14f-7387-449a-84f5-975ae953c264 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:00.621505 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:00.622897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:00.837219 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c63f85b6-2c5b-43ef-85c1-ab7fd38642c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:00.863766 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:00.887543 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5144e376-5c53-4eae-bc6d-2e74e3da345f req-74047928-efc6-44c1-aa60-7cdecf8a62c6 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:00.912498 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5144e376-5c53-4eae-bc6d-2e74e3da345f req-74047928-efc6-44c1-aa60-7cdecf8a62c6 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 931 time: 2.1404195 May 26 14:43:00.922909 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ec4ee3ea-9d36-4c14-a225-a3445629295c {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:00.974586 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c63f85b6-2c5b-43ef-85c1-ab7fd38642c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=faeb384d-f2db-4840-928b-715aac9f2850,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:01.008678 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c63f85b6-2c5b-43ef-85c1-ab7fd38642c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:01.014106 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:01.023060 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:43:01.055044 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Sync routers for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:43:01.073189 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] 10.222.0.72 "PUT /v2.0/routers/f62ef884-b65a-487d-8955-15d95245398f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 13.3671601 May 26 14:43:01.073189 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c63f85b6-2c5b-43ef-85c1-ab7fd38642c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:01.105088 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c63f85b6-2c5b-43ef-85c1-ab7fd38642c3 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/faeb384d-f2db-4840-928b-715aac9f2850 HTTP/1.1" status: 204 len: 168 time: 2.2599895 May 26 14:43:01.108776 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:01.108776 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:01.150834 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Transition to ACTIVE for port object ec4ee3ea-9d36-4c14-a225-a3445629295c will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:01.160694 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:01.168061 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2c16b0ad-30e0-4fa5-9cad-9a17a9d077e1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:01.214594 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5144e376-5c53-4eae-bc6d-2e74e3da345f req-6cc2a742-80b4-4df8-8bfb-a438b358b6f3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2983398 May 26 14:43:01.299734 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:01.307948 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aaea445-407b-4a47-9bc7-f96fa84622b3 req-bd97b8bc-152f-4cbb-adcf-98ada302cd96 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:01.320126 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d716edee-1b42-40f1-9df5-42382e808d45 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:01.325402 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9aaea445-407b-4a47-9bc7-f96fa84622b3 req-bd97b8bc-152f-4cbb-adcf-98ada302cd96 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 932 time: 1.4087996 May 26 14:43:01.432026 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:01.434202 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 3, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:01.442920 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fca9214e-0124-4707-bddf-668f9be994ba None None] The sync data for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi is: [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 3, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:43:01.445872 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Pushing event updated for resources: {'Port': ['ID=ec4ee3ea-9d36-4c14-a225-a3445629295c,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:01.457793 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:01.585159 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Request body: {'port': {'device_id': '0d70a460-f327-420d-902a-7e26b59453d5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:01.674922 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:01.691076 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e058a14f-7387-449a-84f5-975ae953c264 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:01.730053 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9aaea445-407b-4a47-9bc7-f96fa84622b3 req-9ad28778-808e-4079-9694-9142eecdd9f5 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4036608 May 26 14:43:01.776807 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Network d130e7f3-8552-49d7-bcfd-3db8c3289227 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:01.785491 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:01.806022 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:02.007224 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Pushing event updated for resources: {'Port': ['ID=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:02.021683 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.591s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:02.029634 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.247s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:02.086803 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e058a14f-7387-449a-84f5-975ae953c264 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:02.090549 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e058a14f-7387-449a-84f5-975ae953c264 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/7f81237e-73da-448c-a648-efd28525c431 HTTP/1.1" status: 204 len: 168 time: 3.7821143 May 26 14:43:02.184966 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e058a14f-7387-449a-84f5-975ae953c264 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f81237e-73da-448c-a648-efd28525c431,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:02.211830 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e058a14f-7387-449a-84f5-975ae953c264 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:02.296321 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port d716edee-1b42-40f1-9df5-42382e808d45 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:02.303454 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d716edee-1b42-40f1-9df5-42382e808d45 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:02.303837 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:02.324120 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38090) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:02.359492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Attempting to bind port ec4ee3ea-9d36-4c14-a225-a3445629295c on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:02.360779 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Attempting to bind port ec4ee3ea-9d36-4c14-a225-a3445629295c by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:02.361779 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Attempting to bind port ec4ee3ea-9d36-4c14-a225-a3445629295c on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:02.427335 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:02.429998 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Port ec4ee3ea-9d36-4c14-a225-a3445629295c on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:43:02.430376 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Attempting to bind port ec4ee3ea-9d36-4c14-a225-a3445629295c on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:02.434643 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 2, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:02.481173 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Checking router: f62ef884-b65a-487d-8955-15d95245398f for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:43:02.481419 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Updating router f62ef884-b65a-487d-8955-15d95245398f port d2621169-995c-464e-b4f1-7f93fa23a183 binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:43:02.544253 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:02.546722 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Checking segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:02.547314 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Bound using segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:02.554853 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Bound port: ec4ee3ea-9d36-4c14-a225-a3445629295c, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:02.555369 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:02.800852 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:02.845897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38102) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:02.908509 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'security_group': {'name': 'tempest-securitygroup--386914001', 'description': 'tempest-description--1668226613'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:02.941463 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:02.995096 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:03.007928 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:03.100474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:security_group and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:03.162759 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:03.221611 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:03.258685 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:03.318644 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38106) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:03.353674 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] For port ec4ee3ea-9d36-4c14-a225-a3445629295c, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:03.360626 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port d716edee-1b42-40f1-9df5-42382e808d45, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d716edee-1b42-40f1-9df5-42382e808d45,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:03.367996 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] For port ec4ee3ea-9d36-4c14-a225-a3445629295c, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ec4ee3ea-9d36-4c14-a225-a3445629295c,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:03.390069 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:03.402537 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-031941e9-fa9d-422f-a2d0-f2d55b6d748e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=590c2b74d72440f8931888139e8d8ffc&name=default HTTP/1.1" status: 200 len: 2975 time: 1.0091746 May 26 14:43:03.407419 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:03.413134 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38114) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:03.425908 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:03.474453 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:03.540204 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:03.617475 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b693717-6a5a-4b50-9fa6-31a844b395fd req-0053db0b-0290-47ca-92e1-a9b2940c2d05 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:03.619457 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4b693717-6a5a-4b50-9fa6-31a844b395fd req-0053db0b-0290-47ca-92e1-a9b2940c2d05 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 943 time: 0.8758409 May 26 14:43:03.641765 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:03.644984 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Pushing event updated for resources: {'Port': ['ID=ec4ee3ea-9d36-4c14-a225-a3445629295c,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:03.652340 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 878df695-7300-4df7-af49-82e0eea671af up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:03.656228 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Usage tracker for resource:security_group_rule and tenant:61cccc939b734274b38810c51ba40575 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:03.659253 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:03.659399 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:03.672324 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:03.709247 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:03.709923 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:03.711536 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] 10.222.0.79 "PUT /v2.0/ports/ec4ee3ea-9d36-4c14-a225-a3445629295c HTTP/1.1" status: 200 len: 1093 time: 5.4191251 May 26 14:43:03.724178 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '75dff9cc-3473-4c96-8f63-78fe18c37cd3', 'tag': 'ec4ee3ea-9d36-4c14-a225-a3445629295c'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:03.908205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:03.926865 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=d716edee-1b42-40f1-9df5-42382e808d45,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:03.938611 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6b34bb6e-d594-4f11-8acb-403387a3ff98 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:03.951579 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.526s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:03.996759 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6b34bb6e-d594-4f11-8acb-403387a3ff98 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.099790 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 878df695-7300-4df7-af49-82e0eea671af completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:04.115380 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 878df695-7300-4df7-af49-82e0eea671af triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:04.115768 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.135424 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6b34bb6e-d594-4f11-8acb-403387a3ff98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.146782 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1e2e1c33-072d-4d23-bb65-17150f8c3714 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:04.171984 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b34bb6e-d594-4f11-8acb-403387a3ff98 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33070503-2222-49ab-b18c-c97084c35c8e,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:04.173822 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Allocated IP 172.20.0.1 (82f940d8-9b5b-4a1a-9b79-05f05dbfa116/0ff14072-b6ed-4e7e-acdf-9c02d2a054b3/926d9d5c-2945-44cb-898f-bc6ea47b2a43) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:04.186936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6b34bb6e-d594-4f11-8acb-403387a3ff98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:04.211522 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6b34bb6e-d594-4f11-8acb-403387a3ff98 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.212671 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-6b34bb6e-d594-4f11-8acb-403387a3ff98 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/33070503-2222-49ab-b18c-c97084c35c8e HTTP/1.1" status: 204 len: 168 time: 0.7847006 May 26 14:43:04.420101 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.421311 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.499887 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.532575 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6fbfc8b4-ad9d-4cc4-b959-14e8d9b5903d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:04.566481 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Transition to ACTIVE for port object d2621169-995c-464e-b4f1-7f93fa23a183 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:04.582976 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.588006 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.594284 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:04.598273 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9650b7e0-6b25-419e-8a24-02c267172949 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:04.607100 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.625811 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Transition to ACTIVE for port object 9650b7e0-6b25-419e-8a24-02c267172949 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:04.627062 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4b693717-6a5a-4b50-9fa6-31a844b395fd req-b8ab9ff6-2d40-4c4c-993d-ee264279360e tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7141826 May 26 14:43:04.635699 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.642001 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:04.644281 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.661588 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:04.662761 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 878df695-7300-4df7-af49-82e0eea671af, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=878df695-7300-4df7-af49-82e0eea671af,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:04.701497 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=61cccc939b734274b38810c51ba40575&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2573311 May 26 14:43:04.705448 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:security_group_rule and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:04.728697 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:04.743906 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38138) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:04.758164 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Transition to ACTIVE for port object 926d9d5c-2945-44cb-898f-bc6ea47b2a43 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:04.759016 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:04.827663 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:04.840366 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbebab3e-6521-4250-9c28-d3cf0c68887d None None] Pushing event updated for resources: {'Port': ['ID=d2621169-995c-464e-b4f1-7f93fa23a183,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:04.843935 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-dbebab3e-6521-4250-9c28-d3cf0c68887d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:04.849349 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.078s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:04.889154 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Pushing event updated for resources: {'Port': ['ID=9650b7e0-6b25-419e-8a24-02c267172949,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:04.900307 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:04.926484 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=878df695-7300-4df7-af49-82e0eea671af,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:04.930619 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:05.042150 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Attempting to bind port d2621169-995c-464e-b4f1-7f93fa23a183 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:05.042946 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Attempting to bind port d2621169-995c-464e-b4f1-7f93fa23a183 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:05.043536 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Attempting to bind port d2621169-995c-464e-b4f1-7f93fa23a183 on network dcbc30ab-336e-46b8-a284-99efba24886a {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:05.056459 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:05.056983 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Checking segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:05.057591 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.058144 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Bound using segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:05.059620 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Bound port: d2621169-995c-464e-b4f1-7f93fa23a183, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:05.060359 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.091719 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '75dff9cc-3473-4c96-8f63-78fe18c37cd3', 'tag': 'ec4ee3ea-9d36-4c14-a225-a3445629295c', 'status': 'completed', 'code': 200} May 26 14:43:05.104743 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ee82047-0c7f-45ac-bad6-75ad160146d7,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:05.115717 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f49ac5b-964a-4cc2-a6a7-c4ab8dd53f26 req-e3d07fcb-ed27-4183-869d-1cfcba1b1690 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:05.122947 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f49ac5b-964a-4cc2-a6a7-c4ab8dd53f26 req-e3d07fcb-ed27-4183-869d-1cfcba1b1690 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 932 time: 1.9177482 May 26 14:43:05.154859 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.622s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:05.172892 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ad0e5480-f3bf-48a5-8a5c-f2ae4e8f844b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.227904 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-52725712-5bb8-4894-82fe-fc9d7cc75e0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:05.229592 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-52725712-5bb8-4894-82fe-fc9d7cc75e0f service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 1096 time: 0.4188559 May 26 14:43:05.267197 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.280351 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.283966 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] For port d2621169-995c-464e-b4f1-7f93fa23a183, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:05.290386 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] For port d2621169-995c-464e-b4f1-7f93fa23a183, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d2621169-995c-464e-b4f1-7f93fa23a183,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:05.297210 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.302667 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-e44451d7-428f-4cef-8206-c5d8fe1dfadb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:05.318282 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-c12c8347-e2d3-4649-b77f-b9e0b190ae4a service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ec4ee3ea-9d36-4c14-a225-a3445629295c HTTP/1.1" status: 200 len: 217 time: 0.0750179 May 26 14:43:05.320735 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Attempting to bind port 9650b7e0-6b25-419e-8a24-02c267172949 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:05.321064 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Attempting to bind port 9650b7e0-6b25-419e-8a24-02c267172949 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '3932bf42-877e-4f90-8f96-afdb4108b51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1132, 'network_id': '49db6557-68a4-49ce-b847-46383a000b41'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:05.321392 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Attempting to bind port 9650b7e0-6b25-419e-8a24-02c267172949 on network 49db6557-68a4-49ce-b847-46383a000b41 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:05.396247 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:05.397233 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:05.454395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Port 9650b7e0-6b25-419e-8a24-02c267172949 on network 49db6557-68a4-49ce-b847-46383a000b41 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:43:05.454722 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Attempting to bind port 9650b7e0-6b25-419e-8a24-02c267172949 on network 49db6557-68a4-49ce-b847-46383a000b41 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:05.464722 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbebab3e-6521-4250-9c28-d3cf0c68887d None None] Pushing event updated for resources: {'Port': ['ID=d2621169-995c-464e-b4f1-7f93fa23a183,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:05.487501 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-dbebab3e-6521-4250-9c28-d3cf0c68887d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:05.491276 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.004s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:05.493793 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:05.494554 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Checking segment: {'id': '3932bf42-877e-4f90-8f96-afdb4108b51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1132, 'network_id': '49db6557-68a4-49ce-b847-46383a000b41'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:05.494554 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Bound using segment: {'id': '3932bf42-877e-4f90-8f96-afdb4108b51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1132, 'network_id': '49db6557-68a4-49ce-b847-46383a000b41'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:05.494959 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Bound port: 9650b7e0-6b25-419e-8a24-02c267172949, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3932bf42-877e-4f90-8f96-afdb4108b51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1132, 'network_id': '49db6557-68a4-49ce-b847-46383a000b41'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:05.495303 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.541649 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-0b812f78-ce27-446b-94bf-c8c6fe011d76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:05.547505 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-0b812f78-ce27-446b-94bf-c8c6fe011d76 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.2195165 May 26 14:43:05.580716 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:05.595892 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f49ac5b-964a-4cc2-a6a7-c4ab8dd53f26 req-77404b7e-af5f-454b-bd72-d78b37bf4bf4 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4719460 May 26 14:43:05.614472 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ad0e5480-f3bf-48a5-8a5c-f2ae4e8f844b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.683996 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:05.720493 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] For port 9650b7e0-6b25-419e-8a24-02c267172949, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:05.725699 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] For port 9650b7e0-6b25-419e-8a24-02c267172949, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=9650b7e0-6b25-419e-8a24-02c267172949,segment=NetworkSegment(3932bf42-877e-4f90-8f96-afdb4108b51c),segment_id=3932bf42-877e-4f90-8f96-afdb4108b51c)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:05.734627 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:05.756357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Pushing event updated for resources: {'Port': ['ID=926d9d5c-2945-44cb-898f-bc6ea47b2a43,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:05.775522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:05.808710 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.837737 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-d3ddf4fa-9390-4b37-b693-47710312bebf service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1080382 May 26 14:43:05.839421 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f478341d-065d-469f-afa1-6693b9f924e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:05.872671 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.970638 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:05.980900 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ad0e5480-f3bf-48a5-8a5c-f2ae4e8f844b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.016074 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d716edee-1b42-40f1-9df5-42382e808d45 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:06.028522 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:06.029370 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.032872 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] 10.222.0.79 "PUT /v2.0/ports/9650b7e0-6b25-419e-8a24-02c267172949 HTTP/1.1" status: 200 len: 1094 time: 4.5705125 May 26 14:43:06.060183 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.569s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:06.065964 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:06.112004 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ad0e5480-f3bf-48a5-8a5c-f2ae4e8f844b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.113971 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-ad0e5480-f3bf-48a5-8a5c-f2ae4e8f844b admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/8ee82047-0c7f-45ac-bad6-75ad160146d7 HTTP/1.1" status: 204 len: 168 time: 1.3674948 May 26 14:43:06.115198 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.116726 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 3.2682273 May 26 14:43:06.128277 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38192) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:06.132946 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.223666 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'security_group_rule': {'security_group_id': '415194a2-fecb-4491-adab-dcc03a38f19c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:06.244947 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:06.257751 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:security_group_rule and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:06.262766 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:06.267402 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-226790c8-b79a-492f-aa69-5d283e139a43 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=415194a2-fecb-4491-adab-dcc03a38f19c,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:06.276469 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:06.329132 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad0e5480-f3bf-48a5-8a5c-f2ae4e8f844b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ee82047-0c7f-45ac-bad6-75ad160146d7,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:06.336252 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ad0e5480-f3bf-48a5-8a5c-f2ae4e8f844b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.270s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:06.342209 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.214s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:06.342715 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:06.379267 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d577812-d4ab-4cee-a86f-302e3502c90e req-1f925af0-10ba-4f28-b85f-4f38edab250b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:06.381228 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d577812-d4ab-4cee-a86f-302e3502c90e req-1f925af0-10ba-4f28-b85f-4f38edab250b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 943 time: 0.5265739 May 26 14:43:06.395675 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.415497 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Pushing event updated for resources: {'Port': ['ID=9650b7e0-6b25-419e-8a24-02c267172949,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:06.436426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d716edee-1b42-40f1-9df5-42382e808d45 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:06.436713 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.439225 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.600s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:06.469564 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-d6ba7334-735e-43cd-98bb-ababec03885a service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5705216 May 26 14:43:06.510530 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-5ea670ef-5a96-4748-8158-bed2380caf1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:06.513084 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-5ea670ef-5a96-4748-8158-bed2380caf1d service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=57f47a57c1814dd283e52c17dfcb8649&device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 1097 time: 0.3122365 May 26 14:43:06.524277 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d577812-d4ab-4cee-a86f-302e3502c90e req-9947cbed-367e-4582-8beb-5bb781198ec1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1127541 May 26 14:43:06.529937 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.576819 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.583295 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.585308 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:06.635342 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f7c532b1-8309-4109-aa0d-fb08a69f2002,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:06.639488 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.701894 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:06.783849 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-36e32226-6e98-4035-b4eb-209db9fe47e8 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9650b7e0-6b25-419e-8a24-02c267172949 HTTP/1.1" status: 200 len: 217 time: 0.1788433 May 26 14:43:06.785715 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-4cc780e2-d980-43c2-ad16-f50ba01a05ee None None] Provisioning for port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:06.811307 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-4cc780e2-d980-43c2-ad16-f50ba01a05ee None None] Provisioning complete for port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:06.811889 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-4cc780e2-d980-43c2-ad16-f50ba01a05ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.830538 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-936896ab-3a91-4647-b829-132be7404a31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:06.898186 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-b4b87e8b-c2b8-43ec-9af6-2f4dc87f5478 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:06.899656 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-b4b87e8b-c2b8-43ec-9af6-2f4dc87f5478 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=20c9d993-accf-4e4f-9a65-8f9e0b42e9b4 HTTP/1.1" status: 200 len: 852 time: 0.1007428 May 26 14:43:06.914693 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-66a318b8-ff5e-4d52-9db9-5457448d477a req-75c96f01-7613-46ba-ad0b-46a0df808ee4 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4382522 May 26 14:43:06.950449 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:06.951766 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8202219 May 26 14:43:06.955897 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38222) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:06.967365 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'security_group_rule': {'security_group_id': '415194a2-fecb-4491-adab-dcc03a38f19c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:06.983354 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:06.987398 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-cf696cb6-7be4-4193-a496-0583033c91a1 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=49db6557-68a4-49ce-b847-46383a000b41&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0715818 May 26 14:43:06.990568 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:security_group_rule and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:06.995502 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-4cc780e2-d980-43c2-ad16-f50ba01a05ee None None] Port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:43:07.007550 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:07.021523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:07.114228 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 878df695-7300-4df7-af49-82e0eea671af up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:07.177046 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:07.193524 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:05Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:07.198873 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f87f579a-92fd-4f35-a267-7887538e1357 None None] The sync data for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi is: [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:05Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:43:07.224578 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 878df695-7300-4df7-af49-82e0eea671af triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:07.224956 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:07.261868 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:07.387241 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Pushing event updated for resources: {'Port': ['ID=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:07.406294 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.571s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:07.512482 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ebc938-d4ad-4ade-bb48-04546676662a req-a734ae46-af39-4d45-b7de-77c5d3b46f91 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:07.514624 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-71ebc938-d4ad-4ade-bb48-04546676662a req-a734ae46-af39-4d45-b7de-77c5d3b46f91 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 944 time: 0.5580122 May 26 14:43:07.527766 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d70a460-f327-420d-902a-7e26b59453d5', 'tag': '9650b7e0-6b25-419e-8a24-02c267172949'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:07.570804 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:07.657458 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d2621169-995c-464e-b4f1-7f93fa23a183 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:07.706858 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38250) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:07.717004 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-71ebc938-d4ad-4ade-bb48-04546676662a req-5f14902e-e140-424f-ab62-25cd462e11f6 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1346064 May 26 14:43:07.747930 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d70a460-f327-420d-902a-7e26b59453d5', 'tag': '9650b7e0-6b25-419e-8a24-02c267172949', 'status': 'completed', 'code': 200} May 26 14:43:07.758636 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port d2621169-995c-464e-b4f1-7f93fa23a183 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:07.777450 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d2621169-995c-464e-b4f1-7f93fa23a183 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:07.778058 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:07.815950 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-33edc369-e565-4e3b-9707-61f08829d00b service neutron] 10.222.0.79 "GET /v2.0/networks/49db6557-68a4-49ce-b847-46383a000b41?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7663817 May 26 14:43:07.967593 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.013621 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.030375 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port d2621169-995c-464e-b4f1-7f93fa23a183, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d2621169-995c-464e-b4f1-7f93fa23a183,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:08.039358 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.045692 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-da6f5f0a-5eef-4daa-b9d9-7b324b771f5b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:08.049990 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-f020ee27-5e3a-4a67-96aa-899c2cff325b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:08.051961 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-f020ee27-5e3a-4a67-96aa-899c2cff325b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 1096 time: 1.0074854 May 26 14:43:08.061741 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2399f5b-e8e4-4b35-ba41-2988230366aa req-8a782703-0c32-4f6a-b156-2eef4a93b36c service neutron] 10.222.0.79 "GET /v2.0/networks/49db6557-68a4-49ce-b847-46383a000b41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2066352 May 26 14:43:08.086241 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Network d130e7f3-8552-49d7-bcfd-3db8c3289227 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:08.095664 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:08.097473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.123581 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.145775 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.202510 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:08.220524 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=d2621169-995c-464e-b4f1-7f93fa23a183,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:08.227479 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:08.270214 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.301612 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-b340eadb-8c19-4c01-b67c-a586ccd9456a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:08.303320 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-b340eadb-8c19-4c01-b67c-a586ccd9456a service neutron] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 915 time: 0.2338164 May 26 14:43:08.340106 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:08.345911 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38270) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:08.351168 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1982435347-network', 'tenant_id': '3d072d680b644e9e93fdb4a47b31e960'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:08.432082 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:08.481266 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Pushing event updated for resources: {'Port': ['ID=926d9d5c-2945-44cb-898f-bc6ea47b2a43,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:08.533904 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-387a2df4-3226-42ed-b492-25f85cf2f41b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ec4ee3ea-9d36-4c14-a225-a3445629295c HTTP/1.1" status: 200 len: 217 time: 0.1868515 May 26 14:43:08.534579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e77eba92-86b7-4999-b248-d6ba3469fbf7,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:08.538440 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:08.538680 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.336s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:08.539739 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Usage tracker for resource:network and tenant:3d072d680b644e9e93fdb4a47b31e960 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:08.548814 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062bb476-52f0-430b-aa5f-4c489b3bf865 req-a19b5e8b-8736-4657-923d-af6a2f8978be tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:08.551736 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:08.557464 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-062bb476-52f0-430b-aa5f-4c489b3bf865 req-a19b5e8b-8736-4657-923d-af6a2f8978be tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 943 time: 0.5389717 May 26 14:43:08.589569 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.594361 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.6337247 May 26 14:43:08.594361 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:08.597722 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38276) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:08.611785 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:08.623710 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:08.639280 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:floatingip and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:08.641861 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Made reservation on behalf of 3d072d680b644e9e93fdb4a47b31e960 for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:08.644140 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.656726 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:08.683988 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.699630 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:08.721409 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:08.725344 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Usage tracker for resource:security_group_rule and tenant:3d072d680b644e9e93fdb4a47b31e960 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:08.729102 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-71f06633-9864-4d05-bcb0-45536664172e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:08.730607 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-71f06633-9864-4d05-bcb0-45536664172e service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.1801698 May 26 14:43:08.731360 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.739579 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-062bb476-52f0-430b-aa5f-4c489b3bf865 req-1e1c472f-a121-4266-9d78-29c15b8e45c3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1812129 May 26 14:43:08.742176 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:08.748816 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:08.766836 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Router 4b252345-f758-472e-99df-5f8be3fcb13a has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:43:08.778010 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:08.779185 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:08.877874 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.915096 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:08.919720 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.932795 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:08.940280 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-ef3efa85-8451-4fca-8f68-3c6271b2ec68 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1992953 May 26 14:43:08.942557 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b756a546-2177-4600-99dd-601f45f4a28f req-2594bf27-6ce8-4c61-8dff-a68409735dae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:08.944060 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b756a546-2177-4600-99dd-601f45f4a28f req-2594bf27-6ce8-4c61-8dff-a68409735dae service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=57f47a57c1814dd283e52c17dfcb8649&device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 1097 time: 0.6523321 May 26 14:43:08.945230 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Usage tracker for resource:security_group_rule and tenant:cfd53ba2cfdb4c258b8670a7b0288c24 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:08.952930 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:08.960702 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6b34bb6e-d594-4f11-8acb-403387a3ff98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:09.036042 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:09.120688 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1133} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:43:09.141602 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-b8dd9bca-5490-466c-886e-22ae573c32d9 None None] Provisioning complete for port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:09.142085 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b8dd9bca-5490-466c-886e-22ae573c32d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:09.226274 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:43:09.237662 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Sync routers for ids ['4b252345-f758-472e-99df-5f8be3fcb13a'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:43:09.247389 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] 10.222.0.72 "PUT /v2.0/routers/4b252345-f758-472e-99df-5f8be3fcb13a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 15.5105879 May 26 14:43:09.253438 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Routers {'4b252345-f758-472e-99df-5f8be3fcb13a'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:09.256812 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-b8dd9bca-5490-466c-886e-22ae573c32d9 None None] Port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:43:09.257480 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4b252345-f758-472e-99df-5f8be3fcb13a'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:09.267424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b72c47aa-7968-4516-aa91-b20fc2cb1adc req-b522b9dc-7d6d-4636-ad1b-f110145aeb02 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:09.269486 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b72c47aa-7968-4516-aa91-b20fc2cb1adc req-b522b9dc-7d6d-4636-ad1b-f110145aeb02 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 944 time: 0.3101516 May 26 14:43:09.300998 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa9d3cea-662b-491c-9917-ca1cff4fa8b2,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:09.304352 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:09.317025 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:09.317364 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Added segment fbeddf74-3241-418f-ad37-e4f2651836c5 of type vlan for network 70f24af3-66c4-46fe-9f15-8e6f5cb31591 May 26 14:43:09.321132 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Router 3865f36a-0ff1-4ceb-997f-e7f4306675ef has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:43:09.419958 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:09.453840 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b72c47aa-7968-4516-aa91-b20fc2cb1adc req-93d1a2e1-c8a0-4105-b1d8-0b0249c4ee96 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1765065 May 26 14:43:09.460388 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-12d11d88-872d-4b99-8fe7-e1b3a5853ab0 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5007501 May 26 14:43:09.476089 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b756a546-2177-4600-99dd-601f45f4a28f req-49ee3780-b4a7-4653-ba61-f5e7d5faf62b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:09.477873 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b756a546-2177-4600-99dd-601f45f4a28f req-49ee3780-b4a7-4653-ba61-f5e7d5faf62b service neutron] 10.222.0.79 "GET /v2.0/networks?id=49db6557-68a4-49ce-b847-46383a000b41 HTTP/1.1" status: 200 len: 914 time: 0.5196714 May 26 14:43:09.608022 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d2621169-995c-464e-b4f1-7f93fa23a183 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:09.711321 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:43:09.715479 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d2621169-995c-464e-b4f1-7f93fa23a183 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:09.715992 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:09.730292 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] 10.222.0.72 "PUT /v2.0/routers/3865f36a-0ff1-4ceb-997f-e7f4306675ef/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.1474111 May 26 14:43:09.730766 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b756a546-2177-4600-99dd-601f45f4a28f req-2c6109ce-e0bc-4e33-9410-95cf1f80e8ed service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9650b7e0-6b25-419e-8a24-02c267172949 HTTP/1.1" status: 200 len: 217 time: 0.1647186 May 26 14:43:09.740970 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Set router 4b252345-f758-472e-99df-5f8be3fcb13a gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:09.758822 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Sync routers for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:43:09.777820 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:09.785865 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:09.786772 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:09.799464 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:09.800098 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:09.810321 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b437cd8a-11f6-4e53-86d4-50d0ec537d60 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:09.931246 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:09.974372 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:09.980351 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:09.983974 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b756a546-2177-4600-99dd-601f45f4a28f req-c0c5c101-31ee-4ace-ac01-2b1528f1efaa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:09.985431 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b756a546-2177-4600-99dd-601f45f4a28f req-c0c5c101-31ee-4ace-ac01-2b1528f1efaa service neutron] 10.222.0.79 "GET /v2.0/subnets?id=20c9d993-accf-4e4f-9a65-8f9e0b42e9b4 HTTP/1.1" status: 200 len: 852 time: 0.2407343 May 26 14:43:10.064064 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Pushing event updated for resources: {'Network': ['ID=70f24af3-66c4-46fe-9f15-8e6f5cb31591,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:10.075193 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:10.080589 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.029s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:10.089426 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b756a546-2177-4600-99dd-601f45f4a28f req-fcb3daaf-084f-4091-aa0f-4c2589b102b8 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=49db6557-68a4-49ce-b847-46383a000b41&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0793786 May 26 14:43:10.101405 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 2.3419504 May 26 14:43:10.119178 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38326) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:10.132637 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Request body: {'subnet': {'network_id': '70f24af3-66c4-46fe-9f15-8e6f5cb31591', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1982435347-subnet', 'tenant_id': '3d072d680b644e9e93fdb4a47b31e960', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:10.134539 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 70f24af3-66c4-46fe-9f15-8e6f5cb31591 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:43:10.135333 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5f7d033c-13a9-4288-9aac-fb75825ae5a7 req-8f87db43-d516-4b70-bb35-908be8ad4407 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6609347 May 26 14:43:10.141394 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:10.153316 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.173748 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=cfd53ba2cfdb4c258b8670a7b0288c24&name=default HTTP/1.1" status: 200 len: 2979 time: 1.8092504 May 26 14:43:10.229255 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38330) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:10.249677 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Usage tracker for resource:subnet and tenant:3d072d680b644e9e93fdb4a47b31e960 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:10.251022 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port': {'id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:21:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:46Z', 'updated_at': '2021-05-26T14:43:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '0b26b296-28ad-492a-9268-6d6f5e3fb2f1', 'name': '', 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'mac_address': 'fa:16:3e:50:97:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_interface', 'standard_attr_id': 118, 'fixed_ips': [{'subnet_id': 'f9aad151-b793-4393-be42-7258cba2d2e6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:57Z', 'updated_at': '2021-05-26T14:43:05Z', 'revision_number': 2, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'subnets': [{'id': 'f9aad151-b793-4393-be42-7258cba2d2e6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:10.256212 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Checking router: 4b252345-f758-472e-99df-5f8be3fcb13a for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:43:10.256600 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Updating router 4b252345-f758-472e-99df-5f8be3fcb13a port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:43:10.258499 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:10.269083 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8baed50d-e767-462e-bbb7-8493d1dcd9f3,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:10.272522 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:10.299840 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:10.339815 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.356282 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Made reservation on behalf of 3d072d680b644e9e93fdb4a47b31e960 for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:10.360667 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2577413'] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.403749 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b756a546-2177-4600-99dd-601f45f4a28f req-7aafaf73-b0c0-40b9-bf55-054f86ff654b service neutron] 10.222.0.79 "GET /v2.0/networks/49db6557-68a4-49ce-b847-46383a000b41?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2887197 May 26 14:43:10.502571 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device ec4ee3ea-9d36-4c14-a225-a3445629295c details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:43:10.505727 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9567f045-5a8f-4bfd-a556-f7fd40594edf req-ab7facca-fa20-4452-b67a-a18f7b866acb tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:10.514094 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9567f045-5a8f-4bfd-a556-f7fd40594edf req-ab7facca-fa20-4452-b67a-a18f7b866acb tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 943 time: 0.5004966 May 26 14:43:10.557705 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-17735af6-0a35-4e16-86d5-ebc5d268e2e6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:10.558682 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-17735af6-0a35-4e16-86d5-ebc5d268e2e6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Synchronizing usage tracker for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:network {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:10.630711 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ec5dd1a1-12b2-4a19-ae87-3731329aacd6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.637321 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9567f045-5a8f-4bfd-a556-f7fd40594edf req-5b52daeb-7e20-4e36-8eb8-73d93f23187d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1222069 May 26 14:43:10.641230 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-17735af6-0a35-4e16-86d5-ebc5d268e2e6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Unset dirty status for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:network {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:10.644232 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-17735af6-0a35-4e16-86d5-ebc5d268e2e6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 817 time: 0.5538313 May 26 14:43:10.672093 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-009d5e93-30bb-4fdf-ae9d-4b5d1455cc7b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/quotas/ff8cee98b9cc47dd9a86993218bdede9 HTTP/1.1" status: 200 len: 375 time: 0.0139487 May 26 14:43:10.705541 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port ec4ee3ea-9d36-4c14-a225-a3445629295c, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ec4ee3ea-9d36-4c14-a225-a3445629295c,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:10.724956 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': 'ec4ee3ea-9d36-4c14-a225-a3445629295c', 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'port_id': 'ec4ee3ea-9d36-4c14-a225-a3445629295c', 'mac_address': 'fa:16:3e:fd:91:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e482f08e-dc41-4d58-b9cf-6de9798b0585', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:43:10.784880 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.791431 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.798822 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Transition to ACTIVE for port object 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:10.809745 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.816916 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ec4ee3ea-9d36-4c14-a225-a3445629295c {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:10.822835 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:10.859864 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port ec4ee3ea-9d36-4c14-a225-a3445629295c, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ec4ee3ea-9d36-4c14-a225-a3445629295c,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:10.876933 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Allocated IP 172.27.3.98 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/6677c60d-aed9-42fd-90c5-2213e82d84f4) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:10.878930 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.879668 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 9650b7e0-6b25-419e-8a24-02c267172949 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:43:10.890042 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ec5dd1a1-12b2-4a19-ae87-3731329aacd6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:10.964191 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b756a546-2177-4600-99dd-601f45f4a28f req-658165b1-dd3b-4c89-85f2-3f84c65d4e77 service neutron] 10.222.0.79 "GET /v2.0/networks/49db6557-68a4-49ce-b847-46383a000b41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5207877 May 26 14:43:11.040656 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-dbebab3e-6521-4250-9c28-d3cf0c68887d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:11.063209 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Attempting to bind port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:11.063613 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Attempting to bind port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:11.064114 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Attempting to bind port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 on network d130e7f3-8552-49d7-bcfd-3db8c3289227 {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:11.073525 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:11.073974 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Checking segment: {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:11.074519 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.075066 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Bound using segment: {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:11.075558 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Bound port: 0b26b296-28ad-492a-9268-6d6f5e3fb2f1, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:11.075939 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.132190 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 2, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:11.166180 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Checking router: 3865f36a-0ff1-4ceb-997f-e7f4306675ef for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:43:11.167074 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Updating router 3865f36a-0ff1-4ceb-997f-e7f4306675ef port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:43:11.208768 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-7cb76f6a-6821-4b4d-acdc-a0dffa9972fe tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Synchronizing usage tracker for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:11.216665 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] For port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:11.226925 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6887cc48-4c87-483f-9b35-27646fe0ddd9 None None] Pushing event updated for resources: {'Port': ['ID=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:11.230738 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] For port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:11.232142 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-6887cc48-4c87-483f-9b35-27646fe0ddd9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.409s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:11.236038 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ec5dd1a1-12b2-4a19-ae87-3731329aacd6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.239133 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.244387 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-62a5bd6d-d159-47be-ae91-fbc55ce66cbd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:11.265331 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:11.268568 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 9650b7e0-6b25-419e-8a24-02c267172949, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=9650b7e0-6b25-419e-8a24-02c267172949,segment=NetworkSegment(3932bf42-877e-4f90-8f96-afdb4108b51c),segment_id=3932bf42-877e-4f90-8f96-afdb4108b51c)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:11.279768 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.282933 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec5dd1a1-12b2-4a19-ae87-3731329aacd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8baed50d-e767-462e-bbb7-8493d1dcd9f3,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:11.287012 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.290113 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ec5dd1a1-12b2-4a19-ae87-3731329aacd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:11.300311 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=ec4ee3ea-9d36-4c14-a225-a3445629295c,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:11.300963 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ec5dd1a1-12b2-4a19-ae87-3731329aacd6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.304575 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-ec5dd1a1-12b2-4a19-ae87-3731329aacd6 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/8baed50d-e767-462e-bbb7-8493d1dcd9f3 HTTP/1.1" status: 204 len: 168 time: 1.0718777 May 26 14:43:11.313502 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.273s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:11.342205 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.348486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:11.353392 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '9650b7e0-6b25-419e-8a24-02c267172949', 'network_id': '49db6557-68a4-49ce-b847-46383a000b41', 'port_id': '9650b7e0-6b25-419e-8a24-02c267172949', 'mac_address': 'fa:16:3e:c6:06:f8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1132, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20c9d993-accf-4e4f-9a65-8f9e0b42e9b4', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:43:11.496131 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-7cb76f6a-6821-4b4d-acdc-a0dffa9972fe tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Unset dirty status for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:11.496649 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Routers {'4b252345-f758-472e-99df-5f8be3fcb13a'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:11.498948 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-7cb76f6a-6821-4b4d-acdc-a0dffa9972fe tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&fields=id HTTP/1.1" status: 200 len: 255 time: 0.8191030 May 26 14:43:11.507067 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.507874 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4b252345-f758-472e-99df-5f8be3fcb13a'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:11.525109 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:11.540260 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:11.542237 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38348) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:11.545222 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'Port': ['ID=6677c60d-aed9-42fd-90c5-2213e82d84f4,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:11.548760 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:11.558530 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9650b7e0-6b25-419e-8a24-02c267172949 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:11.600814 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1028100930', 'description': 'tempest-description--1884777800'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:11.639922 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.287s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:11.641212 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 9650b7e0-6b25-419e-8a24-02c267172949, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=9650b7e0-6b25-419e-8a24-02c267172949,segment=NetworkSegment(3932bf42-877e-4f90-8f96-afdb4108b51c),segment_id=3932bf42-877e-4f90-8f96-afdb4108b51c)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:11.655411 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:11.664106 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:security_group and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:11.666104 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.668695 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:11.675115 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:11.684841 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-9b2845af-2478-4c4e-a33c-fbfe9bf9686f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:11.692059 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.738150 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:11.750895 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:security_group_rule and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:11.755060 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:11.794149 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6887cc48-4c87-483f-9b35-27646fe0ddd9 None None] Pushing event updated for resources: {'Port': ['ID=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,revision_number=4']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:11.812366 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:11.844749 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-6887cc48-4c87-483f-9b35-27646fe0ddd9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.600s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:11.870067 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.873329 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=9650b7e0-6b25-419e-8a24-02c267172949,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:11.887908 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:11.943674 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:11.997332 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.001966 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-75e0c614-0098-4335-a8cc-27a6ce0e442d service neutron] 10.222.0.72 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4817381 May 26 14:43:12.022573 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5427f285-047d-4886-83f2-ae0cc72ad908 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:12.072143 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38360) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:12.117253 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.122751 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] Set router 4b252345-f758-472e-99df-5f8be3fcb13a gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:12.127240 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.144633 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.145554 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Transition to ACTIVE for port object 926d9d5c-2945-44cb-898f-bc6ea47b2a43 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:12.153440 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.165085 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:12.188219 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:12.190793 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'SecurityGroup': ['ID=885c9e1a-12b0-4463-9740-2b7fe71b6599,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:12.193459 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.198012 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.6540804 May 26 14:43:12.202978 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['9650b7e0-6b25-419e-8a24-02c267172949'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:12.206772 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:12.208199 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38364) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:12.214196 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Usage tracker for resource:security_group_rule and tenant:bd62bf6538f14b9ab68b75729164a2e9 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:12.221262 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'security_group_rule': {'security_group_id': '885c9e1a-12b0-4463-9740-2b7fe71b6599', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:12.227239 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ec4ee3ea-9d36-4c14-a225-a3445629295c'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:12.229425 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:12.237801 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:12.240269 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:12.249559 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:security_group_rule and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:12.253869 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-e9170599-6de0-4505-b2a6-84983e75c310 service neutron] 10.222.0.72 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2381434 May 26 14:43:12.282833 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:12.299498 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1fece5-b6fd-45da-963c-b5c92dd6acbf req-d580787e-898d-4cf4-a5cd-d77370e104f2 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:12.300993 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:12.302998 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-be1fece5-b6fd-45da-963c-b5c92dd6acbf req-d580787e-898d-4cf4-a5cd-d77370e104f2 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 945 time: 0.4443703 May 26 14:43:12.388411 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-be1fece5-b6fd-45da-963c-b5c92dd6acbf req-9f0f3659-d307-42ef-9468-d9427c969d2d tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776701 May 26 14:43:12.389430 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2332857', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2577427'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.397045 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:12.587552 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.612866 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Pushing event updated for resources: {'Subnet': ['ID=29dd1fff-ba1d-46d0-b132-d9d306dbfa6d,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:12.625029 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-83841fff-0d30-4b4f-b124-5306d70f717d req-22324aea-3e31-4f46-8064-9c07a34acb86 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 210 time: 0.0782197 May 26 14:43:12.678736 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:12.681349 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port': {'id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:21:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:46Z', 'updated_at': '2021-05-26T14:43:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '0b26b296-28ad-492a-9268-6d6f5e3fb2f1', 'name': '', 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'mac_address': 'fa:16:3e:50:97:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_interface', 'standard_attr_id': 118, 'fixed_ips': [{'subnet_id': 'f9aad151-b793-4393-be42-7258cba2d2e6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:57Z', 'updated_at': '2021-05-26T14:43:11Z', 'revision_number': 4, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'subnets': [{'id': 'f9aad151-b793-4393-be42-7258cba2d2e6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:12.693836 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7980eca-408a-4b88-8d77-847ea2dc9f1b None None] The sync data for ids ['4b252345-f758-472e-99df-5f8be3fcb13a'] in dv-cinder-774594-6-iscsi is: [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port': {'id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:21:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:46Z', 'updated_at': '2021-05-26T14:43:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '0b26b296-28ad-492a-9268-6d6f5e3fb2f1', 'name': '', 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'mac_address': 'fa:16:3e:50:97:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_interface', 'standard_attr_id': 118, 'fixed_ips': [{'subnet_id': 'f9aad151-b793-4393-be42-7258cba2d2e6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:57Z', 'updated_at': '2021-05-26T14:43:11Z', 'revision_number': 4, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'subnets': [{'id': 'f9aad151-b793-4393-be42-7258cba2d2e6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:43:12.724323 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Checking segment: {'id': 'fbeddf74-3241-418f-ad37-e4f2651836c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '70f24af3-66c4-46fe-9f15-8e6f5cb31591'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:12.724859 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Network hostable DHCP agents. Network: 70f24af3-66c4-46fe-9f15-8e6f5cb31591, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:43:12.812040 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Attempting to bind port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:12.813122 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Attempting to bind port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:12.814136 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Attempting to bind port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 on network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:12.829735 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a940ad-8754-421b-b99a-d2dc151a712a req-500ae246-cf59-4cea-9b14-4c9d77238b2f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:12.831661 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d0a940ad-8754-421b-b99a-d2dc151a712a req-500ae246-cf59-4cea-9b14-4c9d77238b2f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 944 time: 0.2055652 May 26 14:43:12.838224 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Network 70f24af3-66c4-46fe-9f15-8e6f5cb31591 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:43:12.881661 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.899341 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:12.899932 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Checking segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:12.900634 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.901000 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Bound using segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:12.902010 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Bound port: 926d9d5c-2945-44cb-898f-bc6ea47b2a43, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:12.902134 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.911578 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d0a940ad-8754-421b-b99a-d2dc151a712a req-10b9118b-0f7a-4afe-8748-d6b635a8e33d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615940 May 26 14:43:12.913304 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 70f24af3-66c4-46fe-9f15-8e6f5cb31591) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:12.926449 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:12.927409 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.929276 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.931023 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe766a4-3ce6-40aa-ae69-925a22c07dec None None] Pushing event updated for resources: {'Port': ['ID=926d9d5c-2945-44cb-898f-bc6ea47b2a43,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:12.934891 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.940358 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3fe766a4-3ce6-40aa-ae69-925a22c07dec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.775s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:12.950662 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:12.954191 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03e58c2c-3987-4bb1-9fdf-ae9306c4f618 None None] Network 70f24af3-66c4-46fe-9f15-8e6f5cb31591 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:43:12.960026 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f211816c-b832-4192-9247-f94afee9f030 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:13.010224 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 2.8894012 May 26 14:43:13.079525 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bfd41103-7353-4684-aba2-5244502cd95c,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:13.095713 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=bd62bf6538f14b9ab68b75729164a2e9&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0210638 May 26 14:43:13.112498 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38392) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:13.125536 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:13.126031 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bc148b57-4fb8-4e16-9ad2-3b5b91a3065d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.065s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:13.287143 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88104e33-5dd1-4d60-aca2-e423f5876860,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:13.310156 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:13.327411 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.334870 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38402) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:13.335577 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.1256778 May 26 14:43:13.347569 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.db.resource_extend [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] It took 0.23 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 26 14:43:13.370739 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.376719 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'security_group_rule': {'security_group_id': '885c9e1a-12b0-4463-9740-2b7fe71b6599', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:13.386753 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.394932 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:13.396678 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:13.404703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:security_group_rule and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:13.412046 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:13.430334 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:13.452683 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6a46e4dc-f8b5-4fe5-af55-3f708dbe9090 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.506534 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-f9530143-52d4-4305-ad09-2ab12a99ec39 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:13.508308 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-f9530143-52d4-4305-ad09-2ab12a99ec39 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 817 time: 0.4758904 May 26 14:43:13.513216 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.573235 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-0170c61a-a8df-49c1-88df-9269981bddaa tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/quotas/ff8cee98b9cc47dd9a86993218bdede9 HTTP/1.1" status: 200 len: 375 time: 0.0378501 May 26 14:43:13.600056 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] For port 926d9d5c-2945-44cb-898f-bc6ea47b2a43, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:13.667497 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:13.709188 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] For port 926d9d5c-2945-44cb-898f-bc6ea47b2a43, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=926d9d5c-2945-44cb-898f-bc6ea47b2a43,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:13.711339 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6a46e4dc-f8b5-4fe5-af55-3f708dbe9090 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.724280 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'Port': ['ID=6677c60d-aed9-42fd-90c5-2213e82d84f4,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:13.736362 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.340s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:13.791460 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.791809 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.804961 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:13.851265 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.852746 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.2482514 May 26 14:43:13.870607 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6a46e4dc-f8b5-4fe5-af55-3f708dbe9090 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.875568 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:13.902091 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a46e4dc-f8b5-4fe5-af55-3f708dbe9090 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88104e33-5dd1-4d60-aca2-e423f5876860,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:13.913266 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6a46e4dc-f8b5-4fe5-af55-3f708dbe9090 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:13.926017 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6a46e4dc-f8b5-4fe5-af55-3f708dbe9090 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:13.929465 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-6a46e4dc-f8b5-4fe5-af55-3f708dbe9090 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/88104e33-5dd1-4d60-aca2-e423f5876860 HTTP/1.1" status: 204 len: 168 time: 0.8101656 May 26 14:43:13.989660 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:14.005445 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:14.017194 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-c59040b8-8a7b-420f-8bb7-85ce79bb1c2e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4217205 May 26 14:43:14.121518 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f40ad30-1cff-4f8d-ae4b-0def7bcbc1a5 None None] Network 70f24af3-66c4-46fe-9f15-8e6f5cb31591 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:43:14.129684 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6ec86784-b27e-48bf-828b-18b4090d9760 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:14.185617 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:14.199428 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.8638322 May 26 14:43:14.202745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38428) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:14.209364 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:14.222180 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:14.253162 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:floatingip and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:14.263097 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4d91fb2-c643-489d-ae4b-63b553fc60cf,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:14.273858 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:14.286247 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:14.299290 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:14.319282 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5286d9-7488-455e-b099-2318aa997934 req-b79b8f84-2ca6-45e0-96ea-6819ad7caf3f tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:14.333153 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2c5286d9-7488-455e-b099-2318aa997934 req-b79b8f84-2ca6-45e0-96ea-6819ad7caf3f tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 945 time: 0.7191527 May 26 14:43:14.336198 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:14.426384 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe766a4-3ce6-40aa-ae69-925a22c07dec None None] Pushing event updated for resources: {'Port': ['ID=926d9d5c-2945-44cb-898f-bc6ea47b2a43,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:14.513887 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3fe766a4-3ce6-40aa-ae69-925a22c07dec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.709s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:14.515096 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 9650b7e0-6b25-419e-8a24-02c267172949 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:14.580343 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:14.584453 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:14.590785 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:42:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:14.643626 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2c5286d9-7488-455e-b099-2318aa997934 req-59e2ede5-98f7-4fd4-bd59-8e7153f6fd1a tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3065305 May 26 14:43:14.782338 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-c413c326-0249-4b98-bf7a-707d20271a92 service neutron] 10.222.0.72 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7076378 May 26 14:43:14.864010 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4e5aad9f-08cf-4833-b2d7-7e6ff9d22679 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:14.870645 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:14.871053 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4e5aad9f-08cf-4833-b2d7-7e6ff9d22679 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 817 time: 0.4591486 May 26 14:43:14.871339 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:14.900902 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Request body: {'port': {'device_id': 'a8233d5a-1404-4f72-b83a-4725d0a72066', 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227', 'admin_state_up': True, 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:14.927863 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38456) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:14.983012 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1408156273-network', 'tenant_id': '6a1ea03fc5dd43edba5586636771c812'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:15.017251 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 9650b7e0-6b25-419e-8a24-02c267172949 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:15.069478 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 9650b7e0-6b25-419e-8a24-02c267172949 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:15.069478 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.108211 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:15.124866 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Usage tracker for resource:network and tenant:6a1ea03fc5dd43edba5586636771c812 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:15.130808 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:15.138933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:15.181005 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:15.191867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Made reservation on behalf of 6a1ea03fc5dd43edba5586636771c812 for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:15.194140 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.207421 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:15.216175 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.227724 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.239707 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-8c835c00-b3d5-485c-90c6-b958fb226e9d service neutron] 10.222.0.72 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4559681 May 26 14:43:15.247810 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:15.259340 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d3412a-cdb4-4046-8a65-aea750f5c9cb req-e0f75636-e18a-4d0f-ae37-46c4db46f8bc tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:15.260808 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4d3412a-cdb4-4046-8a65-aea750f5c9cb req-e0f75636-e18a-4d0f-ae37-46c4db46f8bc tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 944 time: 0.3339508 May 26 14:43:15.261811 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Usage tracker for resource:security_group_rule and tenant:6a1ea03fc5dd43edba5586636771c812 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:15.264949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:15.279086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Made reservation on behalf of ff8cee98b9cc47dd9a86993218bdede9 for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:15.283060 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.284000 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:15.377046 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4d3412a-cdb4-4046-8a65-aea750f5c9cb req-8ba88b69-595e-4dd0-81fd-a4335443e3f3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1089115 May 26 14:43:15.432517 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.497926 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:15.503815 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.517872 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:15.560838 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.591743 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Allocated IP 172.27.3.238 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/45899353-2a2b-4a22-b434-4c77a4814963) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:15.618258 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Allocated IP 172.20.0.5 (d130e7f3-8552-49d7-bcfd-3db8c3289227/f9aad151-b793-4393-be42-7258cba2d2e6/020637e8-4ec8-4ab3-a8b0-c6891c725214) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:15.631964 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.659571 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-16cb9752-888e-4039-bbb0-e6d8b57366df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Synchronizing usage tracker for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:15.674200 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0b7b0e0b-1fcb-44df-9e56-adec8fc1e43d req-68e5ad33-014f-45e4-96ea-e8313daabe12 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 210 time: 0.1118898 May 26 14:43:15.703617 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1129} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:43:15.716843 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.725351 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:15.729909 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.730270 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Added segment 3f7966c1-cf34-4e3b-abf7-92e4f64f4739 of type vlan for network 8b295999-8ceb-4c41-a27c-38d1d8bea4c3 May 26 14:43:15.818747 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:15.844228 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 9650b7e0-6b25-419e-8a24-02c267172949, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=9650b7e0-6b25-419e-8a24-02c267172949,segment=NetworkSegment(3932bf42-877e-4f90-8f96-afdb4108b51c),segment_id=3932bf42-877e-4f90-8f96-afdb4108b51c)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:15.849675 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d70a460-f327-420d-902a-7e26b59453d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9650b7e0-6b25-419e-8a24-02c267172949'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:15.929177 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:15.987419 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.043568 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.063570 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.126780 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:16.127450 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.206763 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.230501 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:16.233218 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.3042064 May 26 14:43:16.237263 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38506) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:16.255083 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.528s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:16.255664 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.176s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:16.263675 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.264694 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-16cb9752-888e-4039-bbb0-e6d8b57366df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Unset dirty status for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:16.271301 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-16cb9752-888e-4039-bbb0-e6d8b57366df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-securitygroup--386914001&fields=id&tenant_id=f2b58b2245f643ac9193934fdab405c5 HTTP/1.1" status: 200 len: 267 time: 0.7073264 May 26 14:43:16.274792 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:16.287267 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Request body: {'subnet': {'network_id': '8b295999-8ceb-4c41-a27c-38d1d8bea4c3', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1408156273-subnet', 'tenant_id': '6a1ea03fc5dd43edba5586636771c812', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:16.309172 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e93d614d-f4ac-4152-97aa-4e65f7e857a7,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:16.315829 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.386s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:16.318724 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:16.330371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Usage tracker for resource:subnet and tenant:6a1ea03fc5dd43edba5586636771c812 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:16.340438 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:16.346695 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:16.350548 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ae16b56b-b61f-46eb-b6f3-f7e79a2112c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.150s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:16.378822 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Network d130e7f3-8552-49d7-bcfd-3db8c3289227 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:16.379917 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Pushing event updated for resources: {'Port': ['ID=020637e8-4ec8-4ab3-a8b0-c6891c725214,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:16.390235 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:16.392543 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:16.393552 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.394490 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:16.430122 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:16.432045 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=9650b7e0-6b25-419e-8a24-02c267172949,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:16.436963 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:16.506559 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device ec4ee3ea-9d36-4c14-a225-a3445629295c up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:16.526132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:16.531611 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:16.533819 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'Port': ['ID=45899353-2a2b-4a22-b434-4c77a4814963,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:16.539875 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Made reservation on behalf of 6a1ea03fc5dd43edba5586636771c812 for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:16.543208 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2577413'] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.546858 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:16.547492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.551471 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:16.595218 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:16.640609 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port ec4ee3ea-9d36-4c14-a225-a3445629295c completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:16.646889 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7605953 May 26 14:43:16.651778 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port ec4ee3ea-9d36-4c14-a225-a3445629295c triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:16.652254 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.673262 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Request body: {'port': {'device_id': 'a8233d5a-1404-4f72-b83a-4725d0a72066', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:16.712109 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Pushing event updated for resources: {'Network': ['ID=8b295999-8ceb-4c41-a27c-38d1d8bea4c3,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:16.717439 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:13Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:16.727028 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 8b295999-8ceb-4c41-a27c-38d1d8bea4c3 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:43:16.729746 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.379s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:16.745271 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b769bf8-2065-42a1-9cad-916bda952385 req-6956e25b-f801-4ef8-92e1-49690162380e tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:16.750011 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.752963 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6b769bf8-2065-42a1-9cad-916bda952385 req-6956e25b-f801-4ef8-92e1-49690162380e tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 946 time: 0.7782648 May 26 14:43:16.784338 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-521c238c-e914-4ca1-9ad5-56a8f5a07979 None None] The sync data for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi is: [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:13Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:43:16.905914 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-9b8a61bf-7127-4a24-8c17-243c1f7d79e7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:16.906632 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-9b8a61bf-7127-4a24-8c17-243c1f7d79e7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Synchronizing usage tracker for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:network {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:16.910460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:16.956468 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6b769bf8-2065-42a1-9cad-916bda952385 req-a4c00e85-a653-4792-b540-25984d1aaa48 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2024798 May 26 14:43:17.025974 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-9b8a61bf-7127-4a24-8c17-243c1f7d79e7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Unset dirty status for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:network {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:17.027445 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-9b8a61bf-7127-4a24-8c17-243c1f7d79e7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 816 time: 0.7244868 May 26 14:43:17.079702 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-8d88bfaf-4d34-4225-ad1e-44a2494223a9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/quotas/f2b58b2245f643ac9193934fdab405c5 HTTP/1.1" status: 200 len: 375 time: 0.0426793 May 26 14:43:17.147758 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:17.228931 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port ec4ee3ea-9d36-4c14-a225-a3445629295c, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ec4ee3ea-9d36-4c14-a225-a3445629295c,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:17.240115 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:17.244313 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:17.323315 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d70a460-f327-420d-902a-7e26b59453d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9650b7e0-6b25-419e-8a24-02c267172949', 'code': 200} May 26 14:43:17.379105 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=ec4ee3ea-9d36-4c14-a225-a3445629295c,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:17.383358 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:17.417312 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:17.637060 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-02aa0357-4947-4db7-bccf-da7f5a765f74 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&fields=id HTTP/1.1" status: 200 len: 348 time: 0.5349655 May 26 14:43:17.716749 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.db.resource_extend [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 26 14:43:17.765808 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.79', 56556) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:17.868149 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70664f2c-33f1-493b-82c1-7cb43d32febf req-18c78da7-bfad-4f44-bf42-6902338d7a76 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:17.869573 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-70664f2c-33f1-493b-82c1-7cb43d32febf req-18c78da7-bfad-4f44-bf42-6902338d7a76 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 945 time: 0.3086877 May 26 14:43:17.982988 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e663c76b-dda1-46a9-aace-c4c74ae04508 service neutron] 10.222.0.72 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3097003 May 26 14:43:18.021040 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-70664f2c-33f1-493b-82c1-7cb43d32febf req-f7f08ba2-d0aa-46fe-8c6f-8f9932e7ac5a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1412773 May 26 14:43:18.037540 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:18.120958 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3caf4446-6f07-4379-989b-1ee210adde97 req-f234455c-f470-49fa-9962-ba0c5224ad75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:18.122766 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3caf4446-6f07-4379-989b-1ee210adde97 req-f234455c-f470-49fa-9962-ba0c5224ad75 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 1099 time: 0.3557045 May 26 14:43:18.168816 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.176100 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:18.176514 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.225214 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 020637e8-4ec8-4ab3-a8b0-c6891c725214 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:18.263493 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.287719 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-4d87fe61-5fde-43e3-a62a-5f908d9c082f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:18.290283 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-4d87fe61-5fde-43e3-a62a-5f908d9c082f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 817 time: 0.7272530 May 26 14:43:18.304268 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Transition to ACTIVE for port object 020637e8-4ec8-4ab3-a8b0-c6891c725214 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:18.313476 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 926d9d5c-2945-44cb-898f-bc6ea47b2a43 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:18.314525 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Request body: {'port': {'device_id': '5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c', 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227', 'admin_state_up': True, 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:18.332682 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2332857', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2577427'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.337770 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.339021 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:18.345014 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-49c99bea-2c31-4ada-815c-e9110a28532b req-652fdce3-343f-4fe9-994d-2dcec49aa636 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 210 time: 0.1632719 May 26 14:43:18.353267 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Usage tracker for resource:security_group_rule and tenant:f738d522a62e4f65a57f56c62d4df9b8 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:18.376283 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f8b5e895-c9d7-4d8a-b9e8-5ff83aba0744 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:18.405986 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:18.427561 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:18.434870 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-2965ba09-e7da-4b9d-919f-ece593d0a59b service neutron] 10.222.0.72 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4398866 May 26 14:43:18.443276 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:18.458054 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:18.464661 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:18.465136 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.491250 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.db.resource_extend [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 26 14:43:18.547798 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=edab1676-91d4-4f83-8cb4-513820bbc590,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:18.566670 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:18.584824 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Checking segment: {'id': '3f7966c1-cf34-4e3b-abf7-92e4f64f4739', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1129, 'network_id': '8b295999-8ceb-4c41-a27c-38d1d8bea4c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:18.585510 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Network hostable DHCP agents. Network: 8b295999-8ceb-4c41-a27c-38d1d8bea4c3, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:43:18.646836 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.676073 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.711723 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.713143 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Network 8b295999-8ceb-4c41-a27c-38d1d8bea4c3 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:43:18.735310 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 8b295999-8ceb-4c41-a27c-38d1d8bea4c3) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:18.757483 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5c26063-fb50-42b6-bd3a-2f2bd5be9d2d None None] Network 8b295999-8ceb-4c41-a27c-38d1d8bea4c3 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:43:18.767671 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.775186 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:18.775961 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.785864 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Pushing event updated for resources: {'Port': ['ID=020637e8-4ec8-4ab3-a8b0-c6891c725214,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:18.792670 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.349s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:18.798190 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.826730 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 926d9d5c-2945-44cb-898f-bc6ea47b2a43, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=926d9d5c-2945-44cb-898f-bc6ea47b2a43,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:18.839590 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.126s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:18.867767 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c7c21fc5-80ef-4c6d-a02d-ed751745b634 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:18.872405 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:18.878512 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:18.899129 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8b64a8f9-880b-4681-8a4f-a55e1ba250ad req-b8f0c6cb-89f9-4ff3-b869-fe5834b7a126 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 210 time: 0.1148703 May 26 14:43:18.951801 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a812e8a8-b5f5-42d2-9c18-2d60520326fc req-435d58e1-7488-4043-9e59-eed62acef8ee tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:18.953672 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a812e8a8-b5f5-42d2-9c18-2d60520326fc req-435d58e1-7488-4043-9e59-eed62acef8ee tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 946 time: 0.3628943 May 26 14:43:18.954843 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Synchronizing usage tracker for tenant:f738d522a62e4f65a57f56c62d4df9b8 on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:18.957998 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=769fa7f8-ce5f-47d6-99e4-e17d126fe56c,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:18.965074 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:18.966763 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 2.7251101 May 26 14:43:18.975871 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=926d9d5c-2945-44cb-898f-bc6ea47b2a43,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:18.983582 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:19.015162 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:19.031157 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Usage tracker for resource:port and tenant:ff8cee98b9cc47dd9a86993218bdede9 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:19.041838 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:19.070981 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Unset dirty status for tenant:f738d522a62e4f65a57f56c62d4df9b8 on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:19.072186 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3caf4446-6f07-4379-989b-1ee210adde97 req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9289672 May 26 14:43:19.088920 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a812e8a8-b5f5-42d2-9c18-2d60520326fc req-a3179436-3eea-4e6c-97d0-754003ea6eb4 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1271846 May 26 14:43:19.098528 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Attempting to bind port 020637e8-4ec8-4ab3-a8b0-c6891c725214 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:19.098528 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Attempting to bind port 020637e8-4ec8-4ab3-a8b0-c6891c725214 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:19.098528 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Attempting to bind port 020637e8-4ec8-4ab3-a8b0-c6891c725214 on network d130e7f3-8552-49d7-bcfd-3db8c3289227 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:19.108449 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:19.125478 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:19.125478 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'Port': ['ID=45899353-2a2b-4a22-b434-4c77a4814963,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:19.129640 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.290s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:19.135994 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Port 020637e8-4ec8-4ab3-a8b0-c6891c725214 on network d130e7f3-8552-49d7-bcfd-3db8c3289227 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:43:19.136357 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Attempting to bind port 020637e8-4ec8-4ab3-a8b0-c6891c725214 on network d130e7f3-8552-49d7-bcfd-3db8c3289227 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:19.149413 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:19.149835 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Checking segment: {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:19.150236 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Bound using segment: {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:19.150707 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Bound port: 020637e8-4ec8-4ab3-a8b0-c6891c725214, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:19.151062 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:19.182512 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:19.183862 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.9799132 May 26 14:43:19.186927 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Made reservation on behalf of ff8cee98b9cc47dd9a86993218bdede9 for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:19.190636 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:19.264757 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-708094b8-174c-4361-87b3-8e19b33b22d4 None None] Network 8b295999-8ceb-4c41-a27c-38d1d8bea4c3 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:43:19.435321 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75dff9cc-3473-4c96-8f63-78fe18c37cd3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec4ee3ea-9d36-4c14-a225-a3445629295c'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:19.500295 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550f8133-e7de-4b03-b5d2-4a7393367125 req-5e8f2573-f93c-4aa8-a28a-2600b578edbd tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:19.508831 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-550f8133-e7de-4b03-b5d2-4a7393367125 req-5e8f2573-f93c-4aa8-a28a-2600b578edbd tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 945 time: 0.1329217 May 26 14:43:19.583627 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-550f8133-e7de-4b03-b5d2-4a7393367125 req-fde2af86-9633-423e-8fb9-ede7e7a730f6 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734832 May 26 14:43:19.650480 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] For port 020637e8-4ec8-4ab3-a8b0-c6891c725214, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:19.688030 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] For port 020637e8-4ec8-4ab3-a8b0-c6891c725214, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:19.708134 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:19.718889 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Allocated IP 172.20.0.11 (d130e7f3-8552-49d7-bcfd-3db8c3289227/f9aad151-b793-4393-be42-7258cba2d2e6/d08c2c2c-cb18-446f-bc59-613497b03a6c) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:19.751866 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:19.781263 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-00f8bc45-2e1b-4bba-a4c2-a9ca3ac4b034 req-919fc1c1-156f-41fb-b4cb-4f07726bbb64 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 210 time: 0.1367903 May 26 14:43:19.875421 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:19.876043 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:19.877463 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] 10.222.0.79 "PUT /v2.0/ports/020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 200 len: 1093 time: 3.2114367 May 26 14:43:19.877953 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a8233d5a-1404-4f72-b83a-4725d0a72066', 'tag': '020637e8-4ec8-4ab3-a8b0-c6891c725214'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:19.945896 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75dff9cc-3473-4c96-8f63-78fe18c37cd3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec4ee3ea-9d36-4c14-a225-a3445629295c', 'code': 200} May 26 14:43:19.946875 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 926d9d5c-2945-44cb-898f-bc6ea47b2a43 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:20.055175 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a8233d5a-1404-4f72-b83a-4725d0a72066', 'tag': '020637e8-4ec8-4ab3-a8b0-c6891c725214', 'status': 'completed', 'code': 200} May 26 14:43:20.087409 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-e995a869-56bc-4562-bcee-a34d1dcb0ff8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Synchronizing usage tracker for tenant:c906c656a3474e64ab918724c042f2be on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:20.140225 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Pushing event updated for resources: {'Port': ['ID=020637e8-4ec8-4ab3-a8b0-c6891c725214,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:20.168740 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.417s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:20.236423 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-e995a869-56bc-4562-bcee-a34d1dcb0ff8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Unset dirty status for tenant:c906c656a3474e64ab918724c042f2be on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:20.248741 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-e995a869-56bc-4562-bcee-a34d1dcb0ff8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-securitygroup--1028100930&fields=id&tenant_id=c906c656a3474e64ab918724c042f2be HTTP/1.1" status: 200 len: 267 time: 0.2523541 May 26 14:43:20.255474 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-56f17fc0-13d0-4e1c-ae4e-df34443e9690 req-eea632fe-b2e2-4225-9c61-6a0c6d28e8c7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 210 time: 0.1315930 May 26 14:43:20.334629 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:20.335161 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:20.448233 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-e9a28e64-4c92-4833-8ed7-b88fe92a3b50 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:20.449889 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-e9a28e64-4c92-4833-8ed7-b88fe92a3b50 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Synchronizing usage tracker for tenant:c906c656a3474e64ab918724c042f2be on resource:network {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:20.463510 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-f8e3e999-c162-4c1a-94b5-e8139af1478d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:20.465530 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-f8e3e999-c162-4c1a-94b5-e8139af1478d service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1096 time: 0.5069180 May 26 14:43:20.502011 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:20.640236 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-3e84989b-74ed-40dc-992f-1ee21b8aae2c service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 200 len: 217 time: 0.1267190 May 26 14:43:20.650939 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-e9a28e64-4c92-4833-8ed7-b88fe92a3b50 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Unset dirty status for tenant:c906c656a3474e64ab918724c042f2be on resource:network {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:20.652126 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-e9a28e64-4c92-4833-8ed7-b88fe92a3b50 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 811 time: 0.4023314 May 26 14:43:20.726567 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-0854820b-ca02-4119-bdf6-271e9f44267a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/quotas/c906c656a3474e64ab918724c042f2be HTTP/1.1" status: 200 len: 375 time: 0.0367563 May 26 14:43:20.732103 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:20.752759 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:20.781684 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49e54ef-f553-4ebb-a0ec-288094050b46 req-d96d07e7-5797-41be-8398-cf168c7274e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:20.783378 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a49e54ef-f553-4ebb-a0ec-288094050b46 req-d96d07e7-5797-41be-8398-cf168c7274e3 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 1098 time: 0.3301499 May 26 14:43:20.831901 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19263f2-9728-44b5-b17c-2ecb6ad20961 req-b1b373cb-78cf-492f-94d8-bda5a370af98 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:20.837627 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Network d130e7f3-8552-49d7-bcfd-3db8c3289227 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:20.839530 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e19263f2-9728-44b5-b17c-2ecb6ad20961 req-b1b373cb-78cf-492f-94d8-bda5a370af98 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 946 time: 0.3849392 May 26 14:43:20.842828 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:20.848321 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-5191ffc8-b71f-4755-83d0-9276383bc59f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:20.849780 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-5191ffc8-b71f-4755-83d0-9276383bc59f service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.1684954 May 26 14:43:20.850748 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:20.906105 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a49e54ef-f553-4ebb-a0ec-288094050b46 req-f8062516-13d3-45ef-b0d1-da0032d80ac1 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1153300 May 26 14:43:20.925949 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e19263f2-9728-44b5-b17c-2ecb6ad20961 req-ec1c5678-696d-4967-b574-d4236b255c18 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854015 May 26 14:43:20.958139 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-f211f687-2b45-45f9-889e-de981cddacb7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Synchronizing usage tracker for tenant:c906c656a3474e64ab918724c042f2be on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:20.982167 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-f211f687-2b45-45f9-889e-de981cddacb7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Unset dirty status for tenant:c906c656a3474e64ab918724c042f2be on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:20.994857 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-f211f687-2b45-45f9-889e-de981cddacb7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2669458 May 26 14:43:21.050547 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-508f0a99-6f0b-4deb-9591-f3a0346ea86a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0688632 May 26 14:43:21.070795 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Pushing event updated for resources: {'Port': ['ID=d08c2c2c-cb18-446f-bc59-613497b03a6c,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:21.091152 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:21.123710 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:21.127323 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:21.178349 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.8682449 May 26 14:43:21.193593 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-bf165f07-a907-472f-b79f-8479c6dcc9c0 service neutron] 10.222.0.72 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1917348 May 26 14:43:21.209646 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082a2953-a17b-4e80-aaa6-9cce860337a1 req-9c8846a7-b959-42a4-961a-59e5b9f67c17 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:21.211141 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-082a2953-a17b-4e80-aaa6-9cce860337a1 req-9c8846a7-b959-42a4-961a-59e5b9f67c17 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 945 time: 0.1351209 May 26 14:43:21.275306 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Request body: {'port': {'device_id': '5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:21.431815 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-32dc4c46-2f01-49be-afe7-12bcc25d42ac service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2363367 May 26 14:43:21.435410 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-082a2953-a17b-4e80-aaa6-9cce860337a1 req-cedb1c05-1232-4861-a450-44ee015d5b38 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2023249 May 26 14:43:21.439156 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:21.533346 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-043f3397-bfec-400b-84ef-1bde48f3c3db service neutron] 10.222.0.72 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3211837 May 26 14:43:21.551587 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-838b673f-b125-49c9-b49d-9bda4ab4a93f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:21.553097 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-838b673f-b125-49c9-b49d-9bda4ab4a93f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 816 time: 0.3019466 May 26 14:43:21.630189 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3c377e5e-2832-41f7-80c6-bc06c24d4332 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:21.753977 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-8156d27d-1cc0-4da1-8d85-eff038507ae2 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f2b58b2245f643ac9193934fdab405c5 HTTP/1.1" status: 200 len: 379 time: 0.1143584 May 26 14:43:21.763738 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2949cec-d9e2-41c6-bf48-22b1bd9cde06 req-9bae0387-72a8-44b8-99f8-cd4bab512f2c service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3045502 May 26 14:43:21.765893 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'port': {'device_id': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'admin_state_up': True, 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'security_groups': ['415194a2-fecb-4491-adab-dcc03a38f19c']}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:21.812799 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6b50fda-5afd-4286-be8a-8c1c294b4137 req-aae69e28-22cc-4f10-897f-c1590b57b0b9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:21.814516 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e6b50fda-5afd-4286-be8a-8c1c294b4137 req-aae69e28-22cc-4f10-897f-c1590b57b0b9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 932 time: 0.2342618 May 26 14:43:22.096331 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d08c2c2c-cb18-446f-bc59-613497b03a6c {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:22.104868 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:22.120953 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Transition to ACTIVE for port object d08c2c2c-cb18-446f-bc59-613497b03a6c will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:22.135773 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:22.142396 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:22.221823 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-40e46111-d480-4fa3-a432-2ba89a383b7d req-de9682df-405f-4b33-9d6f-e2b655819ea3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 210 time: 0.3957155 May 26 14:43:22.236933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-e6b50fda-5afd-4286-be8a-8c1c294b4137 req-b60a910f-ee31-48d5-af87-f9fafa81988f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Synchronizing usage tracker for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:22.347715 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:22.352059 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-e6b50fda-5afd-4286-be8a-8c1c294b4137 req-b60a910f-ee31-48d5-af87-f9fafa81988f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Unset dirty status for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:22.358974 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e6b50fda-5afd-4286-be8a-8c1c294b4137 req-b60a910f-ee31-48d5-af87-f9fafa81988f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2984068 May 26 14:43:22.361014 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-405a34f4-ccce-4881-b26c-551ed70d100d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:22.362699 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-405a34f4-ccce-4881-b26c-551ed70d100d service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1096 time: 0.4110141 May 26 14:43:22.363670 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Pushing event updated for resources: {'Port': ['ID=d08c2c2c-cb18-446f-bc59-613497b03a6c,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:22.372571 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:port and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:22.405874 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:22.527252 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for port was recalculated. Used quota:3. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:22.538800 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:22.580965 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0339b2f6-3a7c-41b8-9389-c45e769dd130 req-c6a699ad-4a55-49ac-8c11-2c8eb5df27ab tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 210 time: 0.2150061 May 26 14:43:22.585216 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Made reservation on behalf of f2b58b2245f643ac9193934fdab405c5 for: {'port': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:22.594431 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:22.666322 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Attempting to bind port d08c2c2c-cb18-446f-bc59-613497b03a6c on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:22.666797 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Attempting to bind port d08c2c2c-cb18-446f-bc59-613497b03a6c by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:22.667152 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Attempting to bind port d08c2c2c-cb18-446f-bc59-613497b03a6c on network d130e7f3-8552-49d7-bcfd-3db8c3289227 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:22.687399 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Port d08c2c2c-cb18-446f-bc59-613497b03a6c on network d130e7f3-8552-49d7-bcfd-3db8c3289227 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:43:22.687787 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Attempting to bind port d08c2c2c-cb18-446f-bc59-613497b03a6c on network d130e7f3-8552-49d7-bcfd-3db8c3289227 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:22.697639 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-e099d012-0570-4c8c-9077-d2a0555d5f2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:22.699722 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-e099d012-0570-4c8c-9077-d2a0555d5f2e service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.2979310 May 26 14:43:22.701035 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 42, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:22.701524 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Checking segment: {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:22.701933 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Bound using segment: {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:22.702403 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Bound port: d08c2c2c-cb18-446f-bc59-613497b03a6c, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '31f0bd82-c79b-40bf-8404-580a8d30b406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1112, 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:22.702806 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:22.832887 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38716) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:22.901291 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-67a1e687-b7fd-41a9-8bf2-4f394cfdbbf6 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 200 len: 217 time: 0.1285150 May 26 14:43:23.036705 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0618dc98-6ec0-4558-9915-9d13b85ca77d req-2be3e2ba-1783-4bb4-b784-154f242cb5dd tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:23.044685 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0618dc98-6ec0-4558-9915-9d13b85ca77d req-2be3e2ba-1783-4bb4-b784-154f242cb5dd tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 946 time: 0.4108319 May 26 14:43:23.085880 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-74d52719-64e1-4da1-9366-e04e854bc85c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:23.087371 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-74d52719-64e1-4da1-9366-e04e854bc85c service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.1772993 May 26 14:43:23.096578 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] For port d08c2c2c-cb18-446f-bc59-613497b03a6c, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:23.122949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:23.137403 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Allocated IP 172.20.0.12 (dcbc30ab-336e-46b8-a284-99efba24886a/74523655-70dc-48f8-8616-d6b84cac2d6d/8553a1c9-db24-4d4f-8d37-0a358f73ac23) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:23.145559 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-69081d16-1b1a-4171-b737-4c6ffad6652a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0465803 May 26 14:43:23.147137 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] For port d08c2c2c-cb18-446f-bc59-613497b03a6c, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:23.153876 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:23.160913 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6753fa06-45c5-4b47-82b7-adf3862a60b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:23.167832 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0618dc98-6ec0-4558-9915-9d13b85ca77d req-23726741-5f8d-4a22-92bf-31f782ac90f3 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1221933 May 26 14:43:23.169147 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:23.182763 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Usage tracker for resource:security_group_rule and tenant:f4ed3dc9e18f42c78515bc5cc114912a is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:23.187990 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:23.199440 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5239f140-b3ff-4037-afb4-1403eecdc7c0 req-8b5e6d82-ae9a-4c24-bc65-6c6de979b01a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:23.200981 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5239f140-b3ff-4037-afb4-1403eecdc7c0 req-8b5e6d82-ae9a-4c24-bc65-6c6de979b01a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 945 time: 0.3243592 May 26 14:43:23.206839 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:23.269118 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-273dfa30-0218-4162-bbcc-18cba8bd032e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:23.304093 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:23.304705 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:23.306115 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] 10.222.0.79 "PUT /v2.0/ports/d08c2c2c-cb18-446f-bc59-613497b03a6c HTTP/1.1" status: 200 len: 1094 time: 2.0393541 May 26 14:43:23.310866 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c', 'tag': 'd08c2c2c-cb18-446f-bc59-613497b03a6c'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:23.360982 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Pushing event updated for resources: {'Port': ['ID=d08c2c2c-cb18-446f-bc59-613497b03a6c,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:23.367326 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:23.392835 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-4b182e72-149f-4e85-8441-84bbeeb3a608 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2341173 May 26 14:43:23.482234 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5239f140-b3ff-4037-afb4-1403eecdc7c0 req-caf68c2e-3cc8-4b40-8aff-1c54dd0d1240 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2727935 May 26 14:43:23.548444 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.79', 56569) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:23.594918 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c', 'tag': 'd08c2c2c-cb18-446f-bc59-613497b03a6c', 'status': 'completed', 'code': 200} May 26 14:43:23.647174 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f4658cad-2cbc-4737-9459-3b321cb9628f req-6db6c597-8087-4896-b016-82566f601a32 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 210 time: 0.1824403 May 26 14:43:23.790552 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:23.854121 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-fec8ca43-8b21-40c0-90cf-8116f215430e service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4537792 May 26 14:43:23.881589 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-06339bbb-2cb5-469b-8756-9a49234bd825 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:23.885224 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-06339bbb-2cb5-469b-8756-9a49234bd825 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 1097 time: 0.4388204 May 26 14:43:23.899435 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-b9f45dd0-7df8-4e4b-99c8-b69aacb913ca tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:23.903269 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-b9f45dd0-7df8-4e4b-99c8-b69aacb913ca tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 811 time: 0.3478284 May 26 14:43:23.916775 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:23.992521 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.009696 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Transition to ACTIVE for port object 8553a1c9-db24-4d4f-8d37-0a358f73ac23 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:24.036645 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-4a5ff606-9bd6-4777-8db5-452685b7693c service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c HTTP/1.1" status: 200 len: 217 time: 0.1080401 May 26 14:43:24.048895 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.123884 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-edebcf3e-4659-49af-9cc1-5c6498066d18 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Synchronizing usage tracker for tenant:c906c656a3474e64ab918724c042f2be on resource:security_group {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:24.124099 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fd3be4dc-de2d-4b90-8c57-07acfb060fba req-106f2574-c010-408b-9310-67d1f0f71bf2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 210 time: 0.1048145 May 26 14:43:24.145879 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-edebcf3e-4659-49af-9cc1-5c6498066d18 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Unset dirty status for tenant:c906c656a3474e64ab918724c042f2be on resource:security_group {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:24.147386 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-edebcf3e-4659-49af-9cc1-5c6498066d18 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c906c656a3474e64ab918724c042f2be HTTP/1.1" status: 200 len: 380 time: 0.1348391 May 26 14:43:24.148895 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-84879ef1-9a5b-480a-925c-f0df4a9c738f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:24.150679 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-84879ef1-9a5b-480a-925c-f0df4a9c738f service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.1060538 May 26 14:43:24.165299 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:24.169632 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'port': {'device_id': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'admin_state_up': True, 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'security_groups': ['885c9e1a-12b0-4463-9740-2b7fe71b6599']}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:24.239952 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a2fb3b7-ff12-450b-bbe8-ae1de833f641,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:24.253930 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:24.281039 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f4ed3dc9e18f42c78515bc5cc114912a&name=default HTTP/1.1" status: 200 len: 2979 time: 1.4376292 May 26 14:43:24.283040 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38768) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:24.298662 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-b2cc8243-7632-42db-98bd-26ceccef63a2 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1339555 May 26 14:43:24.370355 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cffa27bf-91e6-4f71-a4a5-7608616a2fa1 req-f642a2c1-4835-454f-842c-7a66064d356d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:24.371923 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cffa27bf-91e6-4f71-a4a5-7608616a2fa1 req-f642a2c1-4835-454f-842c-7a66064d356d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 944 time: 0.5124092 May 26 14:43:24.422374 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.449483 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:24.499333 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:24.522616 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 020637e8-4ec8-4ab3-a8b0-c6891c725214 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:43:24.523747 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:24.571370 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38774) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:24.582494 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Made reservation on behalf of c906c656a3474e64ab918724c042f2be for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:24.582814 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.603985 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.604185 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cffa27bf-91e6-4f71-a4a5-7608616a2fa1 req-8abdc7de-f897-45fa-a775-9373a4ffe603 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2002735 May 26 14:43:24.625187 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-b889b6a9-4d31-4b77-a937-f915f415dfca service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3167946 May 26 14:43:24.628773 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Network dcbc30ab-336e-46b8-a284-99efba24886a is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:24.640203 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:24.649861 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:24.657576 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:24.659536 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8d1a3bac-5c8f-4759-b314-e333ac639cf1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.677916 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:24.826448 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8d1a3bac-5c8f-4759-b314-e333ac639cf1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.841933 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 020637e8-4ec8-4ab3-a8b0-c6891c725214, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:24.856367 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '020637e8-4ec8-4ab3-a8b0-c6891c725214', 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227', 'port_id': '020637e8-4ec8-4ab3-a8b0-c6891c725214', 'mac_address': 'fa:16:3e:33:f1:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f9aad151-b793-4393-be42-7258cba2d2e6', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:43:24.908886 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.923331 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.943853 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 020637e8-4ec8-4ab3-a8b0-c6891c725214 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:24.956316 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:24.970686 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:24.971308 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.971497 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 020637e8-4ec8-4ab3-a8b0-c6891c725214, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:24.978600 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:24.980635 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:25.001982 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d054af-b5f4-4986-952f-d31a3224df36 req-33d9b54f-c78f-4b0a-9665-d69f759836b9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:25.003704 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c3d054af-b5f4-4986-952f-d31a3224df36 req-33d9b54f-c78f-4b0a-9665-d69f759836b9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 932 time: 0.1541929 May 26 14:43:25.019715 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8d1a3bac-5c8f-4759-b314-e333ac639cf1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.041546 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8d1a3bac-5c8f-4759-b314-e333ac639cf1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.042951 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-8d1a3bac-5c8f-4759-b314-e333ac639cf1 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/4a2fb3b7-ff12-450b-bbe8-ae1de833f641 HTTP/1.1" status: 204 len: 168 time: 0.7576997 May 26 14:43:25.044591 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.2834029 May 26 14:43:25.048822 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:25.072441 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-24c41b4b-ed49-4936-ba6d-372781863cf6 None None] Provisioning for port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:25.075565 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1a3bac-5c8f-4759-b314-e333ac639cf1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a2fb3b7-ff12-450b-bbe8-ae1de833f641,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:25.081831 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-24c41b4b-ed49-4936-ba6d-372781863cf6 None None] Provisioning complete for port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:25.083008 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-24c41b4b-ed49-4936-ba6d-372781863cf6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.084736 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Request body: {'port': {'device_id': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:25.093934 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-951d0340-d99b-4662-b1ef-9d3cfaa96c77 req-55eb0ff3-9dc1-4c46-9c62-bb92dcf785bd service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4622858 May 26 14:43:25.095052 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Usage tracker for resource:security_group_rule and tenant:fb7f131d68604c25b0f6d53741fc2234 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:25.098388 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:25.124592 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=020637e8-4ec8-4ab3-a8b0-c6891c725214,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:25.141678 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-8d1a3bac-5c8f-4759-b314-e333ac639cf1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:25.155525 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c3d054af-b5f4-4986-952f-d31a3224df36 req-d6a67814-a10d-482d-9f1f-23cc20bee121 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1378031 May 26 14:43:25.155747 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:25.176195 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:25.231021 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-24c41b4b-ed49-4936-ba6d-372781863cf6 None None] Port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:43:25.249670 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.317083 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['020637e8-4ec8-4ab3-a8b0-c6891c725214'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:25.451767 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Allocated IP 172.20.0.8 (82f940d8-9b5b-4a1a-9b79-05f05dbfa116/0ff14072-b6ed-4e7e-acdf-9c02d2a054b3/0ecd487f-30b4-4cc4-b331-76c06312e6b0) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:25.478978 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-36265d5b-70d4-4a31-80a3-998eb052099a req-9986b7f8-5bce-493f-9a26-7fa1767c1a0d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 210 time: 0.1704705 May 26 14:43:25.550949 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.572908 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.629118 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ec5dd1a1-12b2-4a19-ae87-3731329aacd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:25.640786 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5b439-2216-4188-aa40-0f3308099c97 req-b58dfcf5-0087-4407-b4fd-a0f42fd4e8a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:25.640985 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38802) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:25.657359 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cac5b439-2216-4188-aa40-0f3308099c97 req-b58dfcf5-0087-4407-b4fd-a0f42fd4e8a3 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 1097 time: 0.3876610 May 26 14:43:25.705146 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.724686 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:25.728856 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Usage tracker for resource:security_group_rule and tenant:6388dfbfeb334b9f835d8368726e6cd3 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:25.731916 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:25.737733 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:25.765350 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=fb7f131d68604c25b0f6d53741fc2234&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1926103 May 26 14:43:25.781517 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38814) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:25.922624 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a2092a4-8a38-460c-8140-bd0d71f2014b,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:25.944070 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.952311 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.323s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:25.955439 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-07d5fc9f-cba1-46a7-8747-040374acc51f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:25.967911 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21327ccd-bd9b-437f-bb3f-1a59be7a6d71 req-4fdcd896-78dc-4ddf-ad72-d83d69b8f0bd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:25.969447 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21327ccd-bd9b-437f-bb3f-1a59be7a6d71 req-4fdcd896-78dc-4ddf-ad72-d83d69b8f0bd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 944 time: 0.2178295 May 26 14:43:25.983349 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-07d5fc9f-cba1-46a7-8747-040374acc51f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.059620 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-07d5fc9f-cba1-46a7-8747-040374acc51f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.079234 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:26.082463 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.093275 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.097916 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07d5fc9f-cba1-46a7-8747-040374acc51f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a2092a4-8a38-460c-8140-bd0d71f2014b,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:26.099162 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8553a1c9-db24-4d4f-8d37-0a358f73ac23 {{(pid=98445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:26.126129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-07d5fc9f-cba1-46a7-8747-040374acc51f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:26.135805 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:26.145357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.192454 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-07d5fc9f-cba1-46a7-8747-040374acc51f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.199717 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21327ccd-bd9b-437f-bb3f-1a59be7a6d71 req-2deaa83b-b938-4eaa-8c7f-1d1960f9dd8b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2096882 May 26 14:43:26.203673 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-07d5fc9f-cba1-46a7-8747-040374acc51f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/4a2092a4-8a38-460c-8140-bd0d71f2014b HTTP/1.1" status: 204 len: 168 time: 0.4138024 May 26 14:43:26.217711 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5b439-2216-4188-aa40-0f3308099c97 req-02b2b6b6-717d-43cd-a792-c55bc1394af6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:26.220917 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cac5b439-2216-4188-aa40-0f3308099c97 req-02b2b6b6-717d-43cd-a792-c55bc1394af6 service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.5471790 May 26 14:43:26.231265 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.290917 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Transition to ACTIVE for port object 8553a1c9-db24-4d4f-8d37-0a358f73ac23 will not be triggered until provisioned by entity L2. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:26.303173 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=6388dfbfeb334b9f835d8368726e6cd3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6597936 May 26 14:43:26.303173 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.305203 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5fcec7f-18a2-4ff1-ae76-2cf568ebddc9,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:26.319794 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:26.322005 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38834) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:26.350148 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:26.394553 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cac5b439-2216-4188-aa40-0f3308099c97 req-e3deb665-c0d1-413c-9955-591946828315 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c HTTP/1.1" status: 200 len: 217 time: 0.1591928 May 26 14:43:26.517424 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Transition to ACTIVE for port object 0ecd487f-30b4-4cc4-b331-76c06312e6b0 will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:26.564000 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 020637e8-4ec8-4ab3-a8b0-c6891c725214 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:26.585827 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5b439-2216-4188-aa40-0f3308099c97 req-abd71a32-cc69-48ad-b695-c708ba6997f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:26.588009 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cac5b439-2216-4188-aa40-0f3308099c97 req-abd71a32-cc69-48ad-b695-c708ba6997f9 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.1792185 May 26 14:43:26.704979 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cac5b439-2216-4188-aa40-0f3308099c97 req-e5168b6d-9b53-4c52-80a3-2b5a709f27e3 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0960977 May 26 14:43:26.730545 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 020637e8-4ec8-4ab3-a8b0-c6891c725214 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:26.735219 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 020637e8-4ec8-4ab3-a8b0-c6891c725214 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:26.735595 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.738832 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:26.781777 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.432s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:26.901732 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.913672 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:26.918049 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.966756 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 020637e8-4ec8-4ab3-a8b0-c6891c725214, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:26.968594 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8233d5a-1404-4f72-b83a-4725d0a72066', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '020637e8-4ec8-4ab3-a8b0-c6891c725214'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:26.976997 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38850) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:26.977976 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:26.980382 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:27.022213 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:27.029105 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.040388 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:27.053115 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:27.086935 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cdb1a56d-a249-4629-aa07-d9d57f84a591 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.091305 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=020637e8-4ec8-4ab3-a8b0-c6891c725214,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:27.094906 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:27.120049 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'Port': ['ID=0ecd487f-30b4-4cc4-b331-76c06312e6b0,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:27.127978 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:27.132597 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:27.134854 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Attempting to bind port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:27.135206 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Attempting to bind port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:27.135947 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Attempting to bind port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 on network dcbc30ab-336e-46b8-a284-99efba24886a {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:27.140914 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cac5b439-2216-4188-aa40-0f3308099c97 req-d9124fcf-8da2-4c38-8880-47669c137e8f service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4261408 May 26 14:43:27.145877 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Usage tracker for resource:security_group_rule and tenant:30498f5cdad847d8b298ebfd3acec7a8 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:27.149785 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 on network dcbc30ab-336e-46b8-a284-99efba24886a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:43:27.150169 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Attempting to bind port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 on network dcbc30ab-336e-46b8-a284-99efba24886a {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:27.150272 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:27.175238 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c31cb8f8-db65-4dd4-9ba8-99bb75443708 req-c5d6e868-83fe-4eba-940f-b519f7fefe50 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:27.175888 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-c31cb8f8-db65-4dd4-9ba8-99bb75443708 req-c5d6e868-83fe-4eba-940f-b519f7fefe50 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Synchronizing usage tracker for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:27.180282 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cdb1a56d-a249-4629-aa07-d9d57f84a591 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.181923 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:27.189162 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:27.189523 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Checking segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:27.190067 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Bound using segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:27.190600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Bound port: 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'}}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:27.190949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.236381 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f680bb-57e1-46b4-ae45-3cfd2411ee62 req-9301a699-7967-42cf-991c-a3ce580e734a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:27.244733 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-82f680bb-57e1-46b4-ae45-3cfd2411ee62 req-9301a699-7967-42cf-991c-a3ce580e734a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 931 time: 0.4617555 May 26 14:43:27.269990 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:27.270843 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.321310 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.1581523 May 26 14:43:27.348875 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-c31cb8f8-db65-4dd4-9ba8-99bb75443708 req-c5d6e868-83fe-4eba-940f-b519f7fefe50 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Unset dirty status for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:27.349947 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c31cb8f8-db65-4dd4-9ba8-99bb75443708 req-c5d6e868-83fe-4eba-940f-b519f7fefe50 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.9342661 May 26 14:43:27.359536 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Request body: {'port': {'device_id': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:27.380237 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-359a153b-7c88-418a-b5ce-5470e6628d2f None None] Provisioning for port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:27.386230 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-359a153b-7c88-418a-b5ce-5470e6628d2f None None] Provisioning complete for port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:27.386981 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-359a153b-7c88-418a-b5ce-5470e6628d2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.418891 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cac5b439-2216-4188-aa40-0f3308099c97 req-f20f5ece-7a57-45ba-863e-66c3da9eca9c service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2624822 May 26 14:43:27.425642 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-82f680bb-57e1-46b4-ae45-3cfd2411ee62 req-48d555a3-2d53-4e42-8fbd-5563b7828ae2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1798644 May 26 14:43:27.474115 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.478267 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-359a153b-7c88-418a-b5ce-5470e6628d2f None None] Port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:43:27.490360 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, cleared binding levels {{(pid=98445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:27.500933 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8233d5a-1404-4f72-b83a-4725d0a72066', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '020637e8-4ec8-4ab3-a8b0-c6891c725214', 'code': 200} May 26 14:43:27.511293 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c31cb8f8-db65-4dd4-9ba8-99bb75443708 req-03bc8040-bb5c-44e5-9362-9f0fca5086d0 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1458371 May 26 14:43:27.514923 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cdb1a56d-a249-4629-aa07-d9d57f84a591 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.526777 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:27.527896 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:27.553552 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.556347 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb1a56d-a249-4629-aa07-d9d57f84a591 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5fcec7f-18a2-4ff1-ae76-2cf568ebddc9,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:27.559355 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.565164 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.577272 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.580762 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cdb1a56d-a249-4629-aa07-d9d57f84a591 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:27.581503 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:27.591681 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d511406b-30cf-43b7-b40e-eb06d4f55468 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:27.615119 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cdb1a56d-a249-4629-aa07-d9d57f84a591 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.618667 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-cdb1a56d-a249-4629-aa07-d9d57f84a591 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b5fcec7f-18a2-4ff1-ae76-2cf568ebddc9 HTTP/1.1" status: 204 len: 168 time: 1.2809544 May 26 14:43:27.675964 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=30498f5cdad847d8b298ebfd3acec7a8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6945899 May 26 14:43:27.681669 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38864) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:27.695088 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:27.696066 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.697853 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] 10.222.0.79 "PUT /v2.0/ports/8553a1c9-db24-4d4f-8d37-0a358f73ac23 HTTP/1.1" status: 200 len: 1094 time: 2.6263268 May 26 14:43:27.698408 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=823f27f7-e35c-45fc-8ebb-30d0bf81ebef,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:27.709173 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:27.719483 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:27.777804 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=3']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:27.793857 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:27.869379 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adceeb55-2861-489e-8b35-18e156017ee1 req-d774fa34-ada5-4907-8846-e177b2210455 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:27.871118 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-adceeb55-2861-489e-8b35-18e156017ee1 req-d774fa34-ada5-4907-8846-e177b2210455 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 944 time: 0.2448382 May 26 14:43:27.952201 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a95ae57f-7bc8-40cf-a64e-c72330853d88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:27.958337 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-47ce8291-71bd-442a-b1f6-311157fcbd0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:27.960195 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-47ce8291-71bd-442a-b1f6-311157fcbd0a service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 1097 time: 0.1782866 May 26 14:43:27.965452 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-adceeb55-2861-489e-8b35-18e156017ee1 req-ba248718-f9f1-4184-8036-3d091f35df11 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854607 May 26 14:43:28.079350 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-f698cef0-51d4-497c-ba9c-ec71ff7d80e1 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23 HTTP/1.1" status: 200 len: 217 time: 0.1039555 May 26 14:43:28.153923 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a95ae57f-7bc8-40cf-a64e-c72330853d88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:28.199366 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d487f6e-63e5-454c-a33b-61a67ee0ece4 req-eb6981ba-3670-4489-b24a-954e67d3254d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:28.200863 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-1d487f6e-63e5-454c-a33b-61a67ee0ece4 req-eb6981ba-3670-4489-b24a-954e67d3254d service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1098 time: 0.4035060 May 26 14:43:28.302285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-3c350fce-4887-4a97-a55a-8b5c79afe5c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:28.303905 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-3c350fce-4887-4a97-a55a-8b5c79afe5c5 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.2180073 May 26 14:43:28.341354 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-1d487f6e-63e5-454c-a33b-61a67ee0ece4 req-532cc96d-9ffe-47c7-b1d7-2d059088aae0 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1056807 May 26 14:43:28.368441 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a95ae57f-7bc8-40cf-a64e-c72330853d88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:28.368987 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'status': 'completed', 'code': 200} May 26 14:43:28.408456 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8aaf2820-9c17-4252-836c-b9f8d5c1fa43 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:28.434669 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-16a9c77f-18d4-4185-a7cf-5589efc72468 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:28.435874 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a95ae57f-7bc8-40cf-a64e-c72330853d88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=823f27f7-e35c-45fc-8ebb-30d0bf81ebef,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:28.436229 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-16a9c77f-18d4-4185-a7cf-5589efc72468 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1251502 May 26 14:43:28.442294 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a95ae57f-7bc8-40cf-a64e-c72330853d88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:28.457724 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a95ae57f-7bc8-40cf-a64e-c72330853d88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:28.466843 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a95ae57f-7bc8-40cf-a64e-c72330853d88 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/823f27f7-e35c-45fc-8ebb-30d0bf81ebef HTTP/1.1" status: 204 len: 168 time: 0.7613361 May 26 14:43:28.479052 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0ecd487f-30b4-4cc4-b331-76c06312e6b0 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:28.487767 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:28.504541 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Transition to ACTIVE for port object 0ecd487f-30b4-4cc4-b331-76c06312e6b0 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:28.508797 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:28.514968 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-269f37ea-83f2-45f8-9e47-d2be199df38f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:28.555603 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device d08c2c2c-cb18-446f-bc59-613497b03a6c details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:43:28.686019 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Pushing event updated for resources: {'Port': ['ID=0ecd487f-30b4-4cc4-b331-76c06312e6b0,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:28.788711 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:28.955023 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Attempting to bind port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:28.955305 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Attempting to bind port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:28.955678 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Attempting to bind port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 on network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:28.972360 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 on network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:43:28.972963 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Attempting to bind port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 on network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:28.979349 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:28.979787 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Checking segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:28.980237 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Bound using segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:28.980621 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port d08c2c2c-cb18-446f-bc59-613497b03a6c, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:28.980751 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Bound port: 0ecd487f-30b4-4cc4-b331-76c06312e6b0, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:28.981183 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:29.002691 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': 'd08c2c2c-cb18-446f-bc59-613497b03a6c', 'network_id': 'd130e7f3-8552-49d7-bcfd-3db8c3289227', 'port_id': 'd08c2c2c-cb18-446f-bc59-613497b03a6c', 'mac_address': 'fa:16:3e:5f:88:af', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f9aad151-b793-4393-be42-7258cba2d2e6', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:43:29.133164 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:29.186049 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d08c2c2c-cb18-446f-bc59-613497b03a6c {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:29.187061 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] For port 0ecd487f-30b4-4cc4-b331-76c06312e6b0, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:29.190369 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] For port 0ecd487f-30b4-4cc4-b331-76c06312e6b0, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:29.194594 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7f6f60-7190-48e7-a80b-fbeb1751a70c req-d0b31e53-8df0-49df-a2ea-36e6ac81fb3a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:29.196323 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-da7f6f60-7190-48e7-a80b-fbeb1751a70c req-d0b31e53-8df0-49df-a2ea-36e6ac81fb3a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 943 time: 0.5447049 May 26 14:43:29.200010 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:29.205999 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a7172f-b361-4566-8730-505a5c4ffe98 req-216981f2-ce4c-4ab1-90a6-a17c4a01e52e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:29.207825 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-91a7172f-b361-4566-8730-505a5c4ffe98 req-216981f2-ce4c-4ab1-90a6-a17c4a01e52e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.2660515 May 26 14:43:29.211143 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-8e11f6df-99f2-4a59-8373-0dfb1eb29e89 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5999641 May 26 14:43:29.222827 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:29.224650 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port d08c2c2c-cb18-446f-bc59-613497b03a6c, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:29.231073 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:29.238360 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:29.345471 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-da7f6f60-7190-48e7-a80b-fbeb1751a70c req-9049c2d5-02fa-4d4a-b40d-96c2306d2604 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1364136 May 26 14:43:29.381009 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-91a7172f-b361-4566-8730-505a5c4ffe98 req-a2ecb4d9-2a3f-4c6c-a7ae-8b701d328574 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1385803 May 26 14:43:29.421575 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Pushing event updated for resources: {'Port': ['ID=0ecd487f-30b4-4cc4-b331-76c06312e6b0,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:29.432878 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:29.448159 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:29.449255 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:29.452350 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] 10.222.0.79 "PUT /v2.0/ports/0ecd487f-30b4-4cc4-b331-76c06312e6b0 HTTP/1.1" status: 200 len: 1093 time: 2.0978334 May 26 14:43:29.454241 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'tag': '0ecd487f-30b4-4cc4-b331-76c06312e6b0'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:29.454965 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=d08c2c2c-cb18-446f-bc59-613497b03a6c,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:29.466264 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:29.506263 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c03d4b-97c8-43b4-b162-052a61b70b81 req-8063f503-6e68-4ec7-b9e5-fab1ecda91e8 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2648661 May 26 14:43:29.533235 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'tag': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'status': 'completed', 'code': 200} May 26 14:43:29.629652 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['d08c2c2c-cb18-446f-bc59-613497b03a6c'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:29.823985 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-7db48e64-e2c1-4fdd-87fd-ce84f24d9820 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:29.825520 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-7db48e64-e2c1-4fdd-87fd-ce84f24d9820 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 1096 time: 0.2574379 May 26 14:43:29.861682 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58bddbc1-372d-4823-b929-06e3dc902450 req-1557bb28-3d19-4bb9-a7ad-5f1f06e5d877 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:29.875726 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-58bddbc1-372d-4823-b929-06e3dc902450 req-1557bb28-3d19-4bb9-a7ad-5f1f06e5d877 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 945 time: 0.2222414 May 26 14:43:29.895788 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-8e13552d-eda6-44d4-adc3-1634e69b1552 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:29.897934 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-8e13552d-eda6-44d4-adc3-1634e69b1552 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 1097 time: 0.1252270 May 26 14:43:30.000015 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-97cd0467-fc2e-425d-a756-e18a48c6fb42 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0 HTTP/1.1" status: 200 len: 217 time: 0.1200347 May 26 14:43:30.093703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-5e1cef50-fadd-4e03-84ca-481b3a6577d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:30.095469 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-5e1cef50-fadd-4e03-84ca-481b3a6577d4 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.0865877 May 26 14:43:30.101124 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-dbed0d8c-e407-4b1b-999b-3882c1482995 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:30.103005 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-dbed0d8c-e407-4b1b-999b-3882c1482995 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1954074 May 26 14:43:30.112765 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-58bddbc1-372d-4823-b929-06e3dc902450 req-7a9a96a3-ba07-4469-8ba1-4c14e7bcf895 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2349758 May 26 14:43:30.180295 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 38954) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:30.222752 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-ddc14663-dc66-43ac-8940-6b02981674e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:30.224271 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-ddc14663-dc66-43ac-8940-6b02981674e8 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1097817 May 26 14:43:30.231294 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-1c0e6af1-fa0f-4e1e-9946-779bc2b08cb4 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23 HTTP/1.1" status: 200 len: 217 time: 0.1077597 May 26 14:43:30.318970 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-62d66a2f-dd12-48a0-b611-ffad4a701302 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:30.322983 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-62d66a2f-dd12-48a0-b611-ffad4a701302 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0824418 May 26 14:43:30.401572 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:30.454491 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-d606b62a-eeca-4467-84d6-7320e49a4be2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:30.456013 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-d606b62a-eeca-4467-84d6-7320e49a4be2 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1258984 May 26 14:43:30.466645 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:30.473808 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Usage tracker for resource:security_group_rule and tenant:3ef889e2cd2c4fcbbe063ea1c50ea422 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:30.484899 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:30.494527 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:30.500258 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-458836a1-4608-4ff9-ba7e-b0b2f78bfd92 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2609818 May 26 14:43:30.660706 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-6d6ab049-bb6b-4af9-a6cd-11e7c49e1a24 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1890152 May 26 14:43:30.789271 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a922199-9ef1-4831-b6fe-b8544157ad57 req-6a7a388c-4ec6-4644-8c15-4a592fce035c service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2811439 May 26 14:43:30.811380 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-eea0c5a4-7a7a-4b15-bfce-4b27057ccd32 req-64a3aa94-39a0-4611-a258-69834975864e service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1435866 May 26 14:43:30.880041 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:30.893355 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df99e89-0e7a-456f-afc8-35feb8f6bb5e req-b9f54471-e9ac-4228-8c7e-f0bc5fd1595e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:30.894950 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1df99e89-0e7a-456f-afc8-35feb8f6bb5e req-b9f54471-e9ac-4228-8c7e-f0bc5fd1595e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 943 time: 0.2978859 May 26 14:43:30.896354 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:30.904357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66e7216-e99c-41f9-b26f-04d340d5ffb2 req-25905e70-f106-48f3-98d3-e1cce4b79751 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:30.905815 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d66e7216-e99c-41f9-b26f-04d340d5ffb2 req-25905e70-f106-48f3-98d3-e1cce4b79751 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.3076978 May 26 14:43:30.915859 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:31.020830 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=391783c8-9e1b-4900-a4fa-f5a691084f1e,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:31.023714 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-b972b199-7eeb-4c73-a500-1088504937fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:31.025562 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-b972b199-7eeb-4c73-a500-1088504937fe service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 1096 time: 0.0959039 May 26 14:43:31.117143 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=3ef889e2cd2c4fcbbe063ea1c50ea422&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9356720 May 26 14:43:31.118192 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:31.119896 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 38998) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:31.127721 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1df99e89-0e7a-456f-afc8-35feb8f6bb5e req-e532750f-c692-4498-b628-3561124711f9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2209492 May 26 14:43:31.132309 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d66e7216-e99c-41f9-b26f-04d340d5ffb2 req-04f67b11-eee0-47fd-bd3e-9be0312d74b6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2172787 May 26 14:43:31.216299 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-67efab31-a801-4e5f-8c48-d2a45e607990 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:31.217750 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-67efab31-a801-4e5f-8c48-d2a45e607990 service neutron] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 913 time: 0.1776440 May 26 14:43:31.359366 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b887f8-5a51-4aef-87d9-18cd409b5762 req-76a866c3-ffed-46cb-bbf0-4168fade79e3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:31.361612 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1b887f8-5a51-4aef-87d9-18cd409b5762 req-76a866c3-ffed-46cb-bbf0-4168fade79e3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 945 time: 0.0997665 May 26 14:43:31.397068 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-aa2c04ec-4ae7-495f-a39f-1d02617254d6 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0 HTTP/1.1" status: 200 len: 217 time: 0.1624517 May 26 14:43:31.404845 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9736afaa-1393-46f3-b7fe-36f15b4cb637 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:31.428275 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1b887f8-5a51-4aef-87d9-18cd409b5762 req-5351198a-7b88-4d23-8080-870cff0cb1d8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585265 May 26 14:43:31.502082 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9736afaa-1393-46f3-b7fe-36f15b4cb637 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:31.524799 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-84fb3e37-995a-4091-ab82-0c81f6519d22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:31.526247 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-84fb3e37-995a-4091-ab82-0c81f6519d22 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.1192474 May 26 14:43:31.625235 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9736afaa-1393-46f3-b7fe-36f15b4cb637 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:31.631782 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4d733dd3-3d47-446a-b6d7-7d5cda42fba9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:31.643855 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9736afaa-1393-46f3-b7fe-36f15b4cb637 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=391783c8-9e1b-4900-a4fa-f5a691084f1e,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:31.652003 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9736afaa-1393-46f3-b7fe-36f15b4cb637 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:31.652779 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9736afaa-1393-46f3-b7fe-36f15b4cb637 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:31.654226 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9736afaa-1393-46f3-b7fe-36f15b4cb637 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/391783c8-9e1b-4900-a4fa-f5a691084f1e HTTP/1.1" status: 204 len: 168 time: 0.5332487 May 26 14:43:31.656526 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-05df6d26-9485-4470-8015-7a2cacb6ff60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:31.657959 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-05df6d26-9485-4470-8015-7a2cacb6ff60 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1138628 May 26 14:43:31.852684 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-e80f3390-4aac-41bb-a332-89294c11d15a service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1866500 May 26 14:43:31.994148 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f4fa2d7e-d95d-4b38-bba4-aeafe9cb208d req-4ba6133a-2d82-4a18-9329-d263af00e064 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1318779 May 26 14:43:32.415955 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ca74a0-a0bf-46bd-89ac-6bff2d946292 req-7f9aafaf-6375-44ef-95e9-e7ec2b46e880 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:32.417406 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-34ca74a0-a0bf-46bd-89ac-6bff2d946292 req-7f9aafaf-6375-44ef-95e9-e7ec2b46e880 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1422358 May 26 14:43:32.428551 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92fdbd8b-5f94-46d9-922a-b47794a6a6ed req-5e5f4e53-601e-4f8c-a15a-2599d094f6db tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:32.429946 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-92fdbd8b-5f94-46d9-922a-b47794a6a6ed req-5e5f4e53-601e-4f8c-a15a-2599d094f6db tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 943 time: 0.1156013 May 26 14:43:32.499854 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-34ca74a0-a0bf-46bd-89ac-6bff2d946292 req-3e8f8c5e-b362-4353-ac1c-80dc4724cc0a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0688932 May 26 14:43:32.507647 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-92fdbd8b-5f94-46d9-922a-b47794a6a6ed req-d6495940-ee76-4dfe-90c1-a12c14909dbe tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0620050 May 26 14:43:32.511910 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39048) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:32.595309 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:43:32.604849 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device d08c2c2c-cb18-446f-bc59-613497b03a6c up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:32.638924 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1663845399-network', 'tenant_id': '1a5c67cf2b5f455180b60afe8233d534'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:32.643719 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:32.647648 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Usage tracker for resource:network and tenant:1a5c67cf2b5f455180b60afe8233d534 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:32.650587 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:32.656859 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:32.667934 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Made reservation on behalf of 1a5c67cf2b5f455180b60afe8233d534 for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:32.670495 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.687284 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.697065 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13842120-13b0-4232-9053-25dbdee9f2e6 req-b4b5f5c9-bfaa-4e34-a7b6-7b13efb5e436 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:32.698608 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13842120-13b0-4232-9053-25dbdee9f2e6 req-b4b5f5c9-bfaa-4e34-a7b6-7b13efb5e436 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 945 time: 0.0854869 May 26 14:43:32.703411 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:32.707672 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Usage tracker for resource:security_group_rule and tenant:1a5c67cf2b5f455180b60afe8233d534 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:32.710761 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:32.716902 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:32.762139 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13842120-13b0-4232-9053-25dbdee9f2e6 req-28d3ecdb-ae26-4f19-ba6e-e694bea872f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560257 May 26 14:43:32.804371 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port d08c2c2c-cb18-446f-bc59-613497b03a6c completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:32.815444 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port d08c2c2c-cb18-446f-bc59-613497b03a6c triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:32.815815 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.827947 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.832410 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.847186 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1115} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:43:32.858341 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.858692 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Added segment d3f9151f-5909-4b72-bd16-08d37a5eb84a of type vlan for network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 May 26 14:43:32.863937 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:32.873740 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a95ae57f-7bc8-40cf-a64e-c72330853d88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:32.886653 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'port_id': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'mac_address': 'fa:16:3e:1e:15:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:43:32.908613 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.921648 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=deb69b02-d196-40d2-94bd-23224ce4150e,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:32.925086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:32.954516 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.956024 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:32.957555 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:32.965856 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:33.010020 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:33.034141 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8553a1c9-db24-4d4f-8d37-0a358f73ac23 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:33.044679 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:33.071642 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:33.080996 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:33.084235 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:33.089380 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.5729010 May 26 14:43:33.089380 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Pushing event updated for resources: {'Network': ['ID=ed7a1e1a-7ae1-41d4-a402-addaf23d4837,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:33.089380 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39068) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:33.095959 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Request body: {'subnet': {'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1663845399-subnet', 'tenant_id': '1a5c67cf2b5f455180b60afe8233d534', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:33.099788 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:33.102093 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:33.111715 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Usage tracker for resource:subnet and tenant:1a5c67cf2b5f455180b60afe8233d534 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:33.115574 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:33.121436 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:33.133071 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Made reservation on behalf of 1a5c67cf2b5f455180b60afe8233d534 for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:33.135515 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:43:33.136046 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3135806'] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:33.147626 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd08c2c2c-cb18-446f-bc59-613497b03a6c'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:33.226257 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd08c2c2c-cb18-446f-bc59-613497b03a6c', 'code': 200} May 26 14:43:33.244598 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port d08c2c2c-cb18-446f-bc59-613497b03a6c, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:33.258289 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:33.279524 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:33.283311 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:33.294851 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.021s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:33.371176 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=d08c2c2c-cb18-446f-bc59-613497b03a6c,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:33.382375 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:33.571515 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa571e7-b46a-40e5-8968-3f0607881e22 req-8042c289-444e-4fb8-9c42-cae605d278c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:33.572998 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-4fa571e7-b46a-40e5-8968-3f0607881e22 req-8042c289-444e-4fb8-9c42-cae605d278c5 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 1099 time: 0.1045501 May 26 14:43:33.628001 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['8553a1c9-db24-4d4f-8d37-0a358f73ac23'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:33.732388 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-4fa571e7-b46a-40e5-8968-3f0607881e22 req-c3d82669-b38b-4393-85e1-958a0e85bdc9 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1478686 May 26 14:43:33.738418 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3085630', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3135784'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:33.744565 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-53fc1ab1-6b36-472b-bce5-79334347b228 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:33.820964 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Pushing event updated for resources: {'Subnet': ['ID=12c3a6cc-90f7-4a24-9389-58ed3aa06051,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:33.823895 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:33.832333 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Checking segment: {'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:33.832677 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Network hostable DHCP agents. Network: ed7a1e1a-7ae1-41d4-a402-addaf23d4837, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:43:33.851240 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:43:33.863756 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, ed7a1e1a-7ae1-41d4-a402-addaf23d4837) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:33.868800 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98c3a10-055f-43f4-8585-c006e3fa90cc req-1ef16651-8ce9-4279-9e62-4f1312894c32 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:33.870829 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b98c3a10-055f-43f4-8585-c006e3fa90cc req-1ef16651-8ce9-4279-9e62-4f1312894c32 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 943 time: 0.1833792 May 26 14:43:33.874677 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9ec0fde-3760-4ac3-8417-8400b50fde06 None None] Network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:43:33.878094 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f474e523-7ffe-4f0b-b5dc-b211997f3930 req-919955c6-e8f2-4a4a-84f6-6f688ac97c02 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:33.879536 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f474e523-7ffe-4f0b-b5dc-b211997f3930 req-919955c6-e8f2-4a4a-84f6-6f688ac97c02 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 945 time: 0.1373992 May 26 14:43:33.880054 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:33.880787 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:33.902231 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8119032 May 26 14:43:33.953284 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b98c3a10-055f-43f4-8585-c006e3fa90cc req-c4c857e5-099c-4916-958a-4fba046cb114 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0727811 May 26 14:43:33.966379 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f474e523-7ffe-4f0b-b5dc-b211997f3930 req-928eeef9-6c60-44b5-bba2-ac4bf2d51018 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0712538 May 26 14:43:34.119420 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9f19d44-540d-4689-8a31-19c3c930bbbc None None] Network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:43:34.177006 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979da26e-8a3f-4888-92b5-615256902569 req-076eeeb0-2161-479e-8a8c-2d75611bea31 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:34.179002 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-979da26e-8a3f-4888-92b5-615256902569 req-076eeeb0-2161-479e-8a8c-2d75611bea31 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1089749 May 26 14:43:34.237160 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-979da26e-8a3f-4888-92b5-615256902569 req-b4a20cce-08c5-4106-8cbe-b2cc061e5cbd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517845 May 26 14:43:34.485506 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39106) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:34.616620 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 0ecd487f-30b4-4cc4-b331-76c06312e6b0 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:43:34.618460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:34.634660 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:34.643880 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Usage tracker for resource:security_group_rule and tenant:45a343b0c50b43b3b1c71eaa15ff7ae0 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:34.647354 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:34.653797 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:34.743526 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:34.748512 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:34.772047 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 0ecd487f-30b4-4cc4-b331-76c06312e6b0, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:34.772627 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8e6a0cc6-1f32-4843-924b-2f1e8df01db1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:34.786787 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'port_id': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'mac_address': 'fa:16:3e:74:5b:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1134, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:43:34.794969 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=45a343b0c50b43b3b1c71eaa15ff7ae0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3082383 May 26 14:43:34.796086 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39118) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:34.809075 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abfd80f0-d655-448a-9699-f5877812f697,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:34.819110 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:34.860385 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:34.866027 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-76ea14d1-636b-4d93-98c5-6da6eee9d7de admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:34.911432 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-76ea14d1-636b-4d93-98c5-6da6eee9d7de admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:34.913305 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0ecd487f-30b4-4cc4-b331-76c06312e6b0 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:34.932544 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 0ecd487f-30b4-4cc4-b331-76c06312e6b0, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:34.938282 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:34.940486 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-dfc05d62-763a-4ae1-9bc9-c3dd6d0aa8d0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:34.980331 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-76ea14d1-636b-4d93-98c5-6da6eee9d7de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:34.986467 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e058a14f-7387-449a-84f5-975ae953c264 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:35.017894 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76ea14d1-636b-4d93-98c5-6da6eee9d7de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abfd80f0-d655-448a-9699-f5877812f697,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:35.021710 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-76ea14d1-636b-4d93-98c5-6da6eee9d7de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:35.027288 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-76ea14d1-636b-4d93-98c5-6da6eee9d7de admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:35.028463 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-76ea14d1-636b-4d93-98c5-6da6eee9d7de admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/abfd80f0-d655-448a-9699-f5877812f697 HTTP/1.1" status: 204 len: 168 time: 0.2313764 May 26 14:43:35.098660 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=0ecd487f-30b4-4cc4-b331-76c06312e6b0,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:35.110720 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:35.328868 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6885d1ea-dba9-4f81-9c45-806c20566cb5 req-e103d838-7574-46c0-8fff-2b1a71769e43 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:35.331117 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6885d1ea-dba9-4f81-9c45-806c20566cb5 req-e103d838-7574-46c0-8fff-2b1a71769e43 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 944 time: 0.1260946 May 26 14:43:35.349736 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329dd425-fe50-416a-bed9-a880693c2906 req-d751bb9b-4f6c-45b7-8f67-31fe489f5cf3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:35.357803 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-329dd425-fe50-416a-bed9-a880693c2906 req-d751bb9b-4f6c-45b7-8f67-31fe489f5cf3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 945 time: 0.1964309 May 26 14:43:35.444537 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6885d1ea-dba9-4f81-9c45-806c20566cb5 req-f4f5887a-96a5-4363-848a-e6c05bba7a90 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0837080 May 26 14:43:35.482324 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-329dd425-fe50-416a-bed9-a880693c2906 req-43481603-1f3c-4c14-af07-0355f3f8ab87 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1234183 May 26 14:43:35.485507 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['0ecd487f-30b4-4cc4-b331-76c06312e6b0'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:35.526965 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39146) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:35.560260 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:35.641105 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:35.652187 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Usage tracker for resource:security_group_rule and tenant:0e8fd98821cf46cf8bdd7ac00d24f86d is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:35.657024 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:35.666377 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:35.720803 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727b49b7-8d7c-4d15-8149-8c45bd1fdb88 req-9a8b4f09-fc04-45f3-80bb-7015543d7de1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:35.722807 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-727b49b7-8d7c-4d15-8149-8c45bd1fdb88 req-9a8b4f09-fc04-45f3-80bb-7015543d7de1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1340172 May 26 14:43:35.792700 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-727b49b7-8d7c-4d15-8149-8c45bd1fdb88 req-f89ecb99-6c94-45a5-96ff-aeced1a539fe tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628982 May 26 14:43:35.835289 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:35.841726 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:35.872042 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:35.926333 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=0e8fd98821cf46cf8bdd7ac00d24f86d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3980126 May 26 14:43:35.929375 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39160) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:35.954088 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=509d6220-e9c2-491d-93f3-e20f8cf0b258,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:35.963957 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:35.995339 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ad3be9-d559-4ffb-ad2d-adc5f1b9a221 req-9dd4b23f-cdda-4350-b848-b3076bef5694 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:35.996975 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-38ad3be9-d559-4ffb-ad2d-adc5f1b9a221 req-9dd4b23f-cdda-4350-b848-b3076bef5694 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 946 time: 0.1262734 May 26 14:43:36.004610 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fcbdf5dc-574b-445f-85b3-bc354ddb102b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:36.032264 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fcbdf5dc-574b-445f-85b3-bc354ddb102b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:36.084153 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fcbdf5dc-574b-445f-85b3-bc354ddb102b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:36.087814 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:36.099770 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcbdf5dc-574b-445f-85b3-bc354ddb102b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=509d6220-e9c2-491d-93f3-e20f8cf0b258,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:36.102424 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fcbdf5dc-574b-445f-85b3-bc354ddb102b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:36.110334 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fcbdf5dc-574b-445f-85b3-bc354ddb102b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:36.111433 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-fcbdf5dc-574b-445f-85b3-bc354ddb102b admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/509d6220-e9c2-491d-93f3-e20f8cf0b258 HTTP/1.1" status: 204 len: 168 time: 0.1809287 May 26 14:43:36.131445 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-38ad3be9-d559-4ffb-ad2d-adc5f1b9a221 req-d211a3d5-6e7e-419d-980d-adf880e0c17c tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1276412 May 26 14:43:36.194281 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9ab0ba6e-c7ba-444d-882e-e553249005c2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:36.195784 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9ab0ba6e-c7ba-444d-882e-e553249005c2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/networks?id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837 HTTP/1.1" status: 200 len: 809 time: 0.1761119 May 26 14:43:36.212423 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-b2cff5a1-0829-4616-8597-247cd30c9f67 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/quotas/1a5c67cf2b5f455180b60afe8233d534 HTTP/1.1" status: 200 len: 375 time: 0.0101507 May 26 14:43:36.212568 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:43:36.260768 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-7b2331f9-9eab-42e7-ac33-e70622fd708b tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=1a5c67cf2b5f455180b60afe8233d534&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0423040 May 26 14:43:36.397521 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-8bb037e8-fbd4-4f50-b76c-95a578458a2a service neutron] 10.222.0.72 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1292818 May 26 14:43:36.624383 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:36.668880 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-b7376ffa-64c7-42e4-97c3-fd200c02769d service neutron] 10.222.0.72 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2650285 May 26 14:43:36.692092 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b3052c-af43-4fb3-93c4-b5374ce67636 req-cd10688d-2871-4614-8245-6724f357d36f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:36.694101 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79b3052c-af43-4fb3-93c4-b5374ce67636 req-cd10688d-2871-4614-8245-6724f357d36f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 944 time: 0.1388698 May 26 14:43:36.712477 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:36.719225 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:36.719807 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:36.755490 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79b3052c-af43-4fb3-93c4-b5374ce67636 req-da77c2c8-3808-482f-a73a-d4676b168dbd tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520465 May 26 14:43:36.960715 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:37.034845 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:37.036239 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:37.054340 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:37.057944 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-e00ea075-0a66-431a-bb5f-f872f0fc7e3c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:37.072372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f896766-b970-4f09-b71a-cf188459a4ea req-e08daacb-e288-49fc-8001-16267688c30e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:37.080188 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f896766-b970-4f09-b71a-cf188459a4ea req-e08daacb-e288-49fc-8001-16267688c30e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 945 time: 0.1774957 May 26 14:43:37.146700 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828be49b-cca4-43d6-9289-75d01fd2364d req-89586650-b1ff-4397-aee5-ecb1e0a61047 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:37.148370 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-828be49b-cca4-43d6-9289-75d01fd2364d req-89586650-b1ff-4397-aee5-ecb1e0a61047 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1660640 May 26 14:43:37.159856 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f896766-b970-4f09-b71a-cf188459a4ea req-dad79cc2-812f-43a4-95b3-955a8d33f176 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0766208 May 26 14:43:37.185910 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:37.199225 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:37.310658 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-89804064-27d1-4657-b7c4-776b25f5e1b2 req-ffa95663-a4a7-46dc-b21e-b0366765e414 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 210 time: 0.0601702 May 26 14:43:37.330465 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-828be49b-cca4-43d6-9289-75d01fd2364d req-9eea5838-0e6d-4f94-8025-fe84f2491bfc tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1694379 May 26 14:43:37.411032 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'code': 200} May 26 14:43:37.668106 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90eb8f9d-4ea0-4697-9096-0fff313b00a9 req-6df4cdb8-2f9f-47cf-a262-58460f0341d2 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:37.671766 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-90eb8f9d-4ea0-4697-9096-0fff313b00a9 req-6df4cdb8-2f9f-47cf-a262-58460f0341d2 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 946 time: 0.1945066 May 26 14:43:37.780924 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-90eb8f9d-4ea0-4697-9096-0fff313b00a9 req-2cada670-0001-428f-91dc-ecbf97cb51d0 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004045 May 26 14:43:37.997999 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c1609a-7c63-4cb6-8eec-726519d7ef90 req-d0255474-d093-40d0-a0e9-edbb91d5037c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:38.003132 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-72c1609a-7c63-4cb6-8eec-726519d7ef90 req-d0255474-d093-40d0-a0e9-edbb91d5037c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 944 time: 0.1263547 May 26 14:43:38.102785 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0a2760-fa38-4801-b1c6-114c616ad8e7 req-96dd180b-8964-43a5-9df7-99c1e024e50f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:38.108620 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc0a2760-fa38-4801-b1c6-114c616ad8e7 req-96dd180b-8964-43a5-9df7-99c1e024e50f service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 1099 time: 0.2090845 May 26 14:43:38.165154 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc0a2760-fa38-4801-b1c6-114c616ad8e7 req-d59bbdcd-f15b-4e20-8244-cdd82580c6c3 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403581 May 26 14:43:38.198235 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-72c1609a-7c63-4cb6-8eec-726519d7ef90 req-da9408e3-0f65-4d08-8878-bd51903fc52a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1901050 May 26 14:43:38.230045 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5781487d-6295-438a-963c-8d9873d963fc req-acf84d7c-6b69-4051-8969-c7a89c9ee69b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:38.231683 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5781487d-6295-438a-963c-8d9873d963fc req-acf84d7c-6b69-4051-8969-c7a89c9ee69b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 1099 time: 0.1517248 May 26 14:43:38.242997 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30227f97-b2ee-41dc-ab70-0cea6706d569 req-6f7e2645-1d43-489c-988a-9942f934f03e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:38.244555 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30227f97-b2ee-41dc-ab70-0cea6706d569 req-6f7e2645-1d43-489c-988a-9942f934f03e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.2164571 May 26 14:43:38.294670 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30227f97-b2ee-41dc-ab70-0cea6706d569 req-b9c712a0-e257-41df-b15f-857864e69007 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436101 May 26 14:43:38.437791 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9a601f8-3125-4ccf-9ea0-1b9ccfb2e116 req-026adbff-a550-47f3-a9f0-5c8225cb44fb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:38.439597 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a9a601f8-3125-4ccf-9ea0-1b9ccfb2e116 req-026adbff-a550-47f3-a9f0-5c8225cb44fb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0997493 May 26 14:43:38.521127 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f17e2092-10c4-4ecc-ae69-01b2b5caee8f req-fe9ee949-0918-42b1-8d81-88f201851583 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 210 time: 0.0803728 May 26 14:43:38.607502 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 0ecd487f-30b4-4cc4-b331-76c06312e6b0 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:38.610658 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a9a601f8-3125-4ccf-9ea0-1b9ccfb2e116 req-8a31f7ae-e6f3-4e8c-9d25-6297e440a13d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1381807 May 26 14:43:38.658036 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5781487d-6295-438a-963c-8d9873d963fc req-cd26665c-c696-4355-9b36-be998e2b17d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:38.659687 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5781487d-6295-438a-963c-8d9873d963fc req-cd26665c-c696-4355-9b36-be998e2b17d8 service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.1609719 May 26 14:43:38.691220 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:38.697301 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:38.697952 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:38.761032 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5781487d-6295-438a-963c-8d9873d963fc req-5ecccb5e-3020-4205-9f93-a4500ac248a3 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c HTTP/1.1" status: 200 len: 217 time: 0.0811636 May 26 14:43:38.768616 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4324d6-21ae-4539-8521-101286e9d40f req-fecb7f62-6c5f-4e41-b62e-f805d1892309 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:38.768953 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-5a4324d6-21ae-4539-8521-101286e9d40f req-fecb7f62-6c5f-4e41-b62e-f805d1892309 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Synchronizing usage tracker for tenant:57f47a57c1814dd283e52c17dfcb8649 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:38.807966 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-5a4324d6-21ae-4539-8521-101286e9d40f req-fecb7f62-6c5f-4e41-b62e-f805d1892309 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Unset dirty status for tenant:57f47a57c1814dd283e52c17dfcb8649 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:38.809622 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5a4324d6-21ae-4539-8521-101286e9d40f req-fecb7f62-6c5f-4e41-b62e-f805d1892309 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.79 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 946 time: 0.1306069 May 26 14:43:38.840244 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5781487d-6295-438a-963c-8d9873d963fc req-0d84e022-fde3-4a67-809c-b22d0219483d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:38.841977 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5781487d-6295-438a-963c-8d9873d963fc req-0d84e022-fde3-4a67-809c-b22d0219483d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.0740173 May 26 14:43:38.864566 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:38.904878 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 0ecd487f-30b4-4cc4-b331-76c06312e6b0, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:38.912366 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:38.918215 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-cd6d1c1f-ce80-48be-9a11-abf16a6903b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:38.927088 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5781487d-6295-438a-963c-8d9873d963fc req-b1024a84-10be-44a9-b301-79c7fdc36e29 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0689309 May 26 14:43:39.008311 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=0ecd487f-30b4-4cc4-b331-76c06312e6b0,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:39.013161 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:39.032914 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Deleting port 9650b7e0-6b25-419e-8a24-02c267172949 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:43:39.033128 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:39.173151 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5781487d-6295-438a-963c-8d9873d963fc req-fc202056-9c56-4eac-a1ff-deb78d7349ec service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2375126 May 26 14:43:39.221828 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8a9a7a-cba1-421b-b676-f52df3dbf13c req-5f585e66-de37-447f-a83f-240e6885cc66 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:39.224933 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2e8a9a7a-cba1-421b-b676-f52df3dbf13c req-5f585e66-de37-447f-a83f-240e6885cc66 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 946 time: 0.1945195 May 26 14:43:39.271104 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39300) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:39.304519 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] For port 9650b7e0-6b25-419e-8a24-02c267172949, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=9650b7e0-6b25-419e-8a24-02c267172949,segment=NetworkSegment(3932bf42-877e-4f90-8f96-afdb4108b51c),segment_id=3932bf42-877e-4f90-8f96-afdb4108b51c)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:39.305218 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:39.412450 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ecd487f-30b4-4cc4-b331-76c06312e6b0'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:39.464677 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Calling delete_port for 9650b7e0-6b25-419e-8a24-02c267172949 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:43:39.509918 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:39.537272 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2e8a9a7a-cba1-421b-b676-f52df3dbf13c req-d26aef66-bd57-448e-9c29-bce3b109c13c tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/security-groups?id=ecb5754d-a6d1-43a1-82d0-25cec65d5699&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3046060 May 26 14:43:39.588044 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5781487d-6295-438a-963c-8d9873d963fc req-261943aa-6512-4c03-80a1-8d7b7d8496d9 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3981848 May 26 14:43:39.599434 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-b5a1e165-82aa-47b1-a564-8ffceb2afe68 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:39.600158 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-b5a1e165-82aa-47b1-a564-8ffceb2afe68 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Synchronizing usage tracker for tenant:1a5c67cf2b5f455180b60afe8233d534 on resource:network {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:43:39.604175 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f84e0aa-79bd-400f-b471-f3370450cd29 req-803904cc-7a0c-47c2-872d-7d9a37a9f1ec tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:39.604313 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:39.610128 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Usage tracker for resource:security_group_rule and tenant:58fd68b988cc47b89bd67836791f6d61 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:39.611765 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9f84e0aa-79bd-400f-b471-f3370450cd29 req-803904cc-7a0c-47c2-872d-7d9a37a9f1ec tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1656861 May 26 14:43:39.615910 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:39.626503 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:39.661978 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-b5a1e165-82aa-47b1-a564-8ffceb2afe68 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Unset dirty status for tenant:1a5c67cf2b5f455180b60afe8233d534 on resource:network {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:43:39.663689 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-b5a1e165-82aa-47b1-a564-8ffceb2afe68 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.79 "GET /v2.0/networks?id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837 HTTP/1.1" status: 200 len: 809 time: 0.5226119 May 26 14:43:39.668459 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9f84e0aa-79bd-400f-b471-f3370450cd29 req-d1cfc0c9-bc33-492e-aed0-c87f23d85ff1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0552754 May 26 14:43:39.743828 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Request body: {'port': {'device_id': '9b85793c-a6bc-44a6-8692-4281b66fbcf3', 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837', 'admin_state_up': True, 'tenant_id': '1a5c67cf2b5f455180b60afe8233d534'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:39.764062 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'code': 200} May 26 14:43:39.804254 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c2721a-11f4-4245-9e76-5b5f069fdd08 req-01a2315c-9ccd-4231-9325-77963b3090f8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:39.813346 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c2721a-11f4-4245-9e76-5b5f069fdd08 req-01a2315c-9ccd-4231-9325-77963b3090f8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1269577 May 26 14:43:39.894244 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c2721a-11f4-4245-9e76-5b5f069fdd08 req-1d5e753c-215b-4940-bc0d-cb2cdc0217a4 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796406 May 26 14:43:39.922972 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:39.924000 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:39.950587 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:39.976739 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['9650b7e0-6b25-419e-8a24-02c267172949'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:40.029847 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Pushing event deleted for resources: {'Port': ['ID=9650b7e0-6b25-419e-8a24-02c267172949,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:40.050029 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5e918e89-1b2b-4332-9dfb-5527758913e5 req-850805ed-bdb6-4108-a353-4628dc9aed17 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 210 time: 0.1037626 May 26 14:43:40.060083 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.096769 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.097134 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.097495 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.097853 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.098194 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.098565 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.098910 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.099255 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.099599 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.099939 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.100275 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.100618 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:40.114637 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39334) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:40.135877 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:40.140863 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.064s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:40.161319 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee580b14-b819-4ce0-82c7-f95fbab0a015 req-2b61b696-872e-4421-9a2a-781e8eea9771 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:40.162247 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] No DVR routers for this DVR port 9650b7e0-6b25-419e-8a24-02c267172949 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:43:40.163321 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ee580b14-b819-4ce0-82c7-f95fbab0a015 req-2b61b696-872e-4421-9a2a-781e8eea9771 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1522183 May 26 14:43:40.178112 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.184896 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d70a460-f327-420d-902a-7e26b59453d5', 'name': 'network-vif-deleted', 'tag': '9650b7e0-6b25-419e-8a24-02c267172949'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:40.190794 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:40.213772 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Usage tracker for resource:port and tenant:1a5c67cf2b5f455180b60afe8233d534 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:40.220902 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=58fd68b988cc47b89bd67836791f6d61&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9396114 May 26 14:43:40.222955 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39340) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:40.223705 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:40.234502 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d98872a-4e35-4dee-9cdf-f4aaa7458342,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:40.237245 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:40.253450 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d70a460-f327-420d-902a-7e26b59453d5', 'name': 'network-vif-deleted', 'tag': '9650b7e0-6b25-419e-8a24-02c267172949', 'status': 'completed', 'code': 200} May 26 14:43:40.258995 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:40.267986 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5a4324d6-21ae-4539-8521-101286e9d40f req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.79 "DELETE /v2.0/ports/9650b7e0-6b25-419e-8a24-02c267172949 HTTP/1.1" status: 204 len: 173 time: 1.4526894 May 26 14:43:40.269570 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_v2 [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Deleting subnet 29dd1fff-ba1d-46d0-b132-d9d306dbfa6d {{(pid=98445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:43:40.275150 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Made reservation on behalf of 1a5c67cf2b5f455180b60afe8233d534 for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:40.275941 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ee580b14-b819-4ce0-82c7-f95fbab0a015 req-9afffe1d-1f8a-4638-a990-5bc91946aaea tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1067946 May 26 14:43:40.277178 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.278602 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.339950 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2677826'] for subnet, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.393052 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b71e46e-4409-47d7-a455-27f9d12f4e6c req-28cffb47-0c91-487b-8044-0fade4267acf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:40.394658 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0b71e46e-4409-47d7-a455-27f9d12f4e6c req-28cffb47-0c91-487b-8044-0fade4267acf service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 1098 time: 0.1932778 May 26 14:43:40.404081 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.404479 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2390504c-1f17-4376-a7da-90c244aef27a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.481080 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2390504c-1f17-4376-a7da-90c244aef27a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.511545 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Allocated IP 172.20.0.6 (ed7a1e1a-7ae1-41d4-a402-addaf23d4837/12c3a6cc-90f7-4a24-9389-58ed3aa06051/2e45fc02-4af4-4423-b131-3a6415bee331) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:40.573875 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2390504c-1f17-4376-a7da-90c244aef27a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.578610 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:40.598129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2390504c-1f17-4376-a7da-90c244aef27a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d98872a-4e35-4dee-9cdf-f4aaa7458342,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:40.602761 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2390504c-1f17-4376-a7da-90c244aef27a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:40.633613 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0b71e46e-4409-47d7-a455-27f9d12f4e6c req-c8d4a152-6417-462e-b8b0-82d856489592 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1979105 May 26 14:43:40.707469 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c574f8fa-e2f2-409e-8524-8907467777be req-73f70dde-ea87-46a2-bd50-bd15fd9c53fd tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.0580471 May 26 14:43:40.725875 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8453c6e-0e58-4318-9905-627358aeaa31 req-0a668ec9-050a-478b-81f3-fb5c2fe7b1c8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:40.736802 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a8453c6e-0e58-4318-9905-627358aeaa31 req-0a668ec9-050a-478b-81f3-fb5c2fe7b1c8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.2965870 May 26 14:43:40.737331 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39352) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:40.747417 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'floatingip': {'port_id': '8553a1c9-db24-4d4f-8d37-0a358f73ac23'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:40.765488 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2390504c-1f17-4376-a7da-90c244aef27a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.766640 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-2390504c-1f17-4376-a7da-90c244aef27a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/0d98872a-4e35-4dee-9cdf-f4aaa7458342 HTTP/1.1" status: 204 len: 168 time: 0.5392518 May 26 14:43:40.858417 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.860379 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.891952 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:40.898058 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ca4d4229-800d-4384-8211-a4461c02d467 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:40.971426 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:40.974621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:40.978405 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:41.009003 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Pushing event updated for resources: {'Port': ['ID=2e45fc02-4af4-4423-b131-3a6415bee331,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:41.016004 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:41.054602 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:41.055311 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.080169 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3416238 May 26 14:43:41.128733 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39364) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:41.132643 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Request body: {'port': {'device_id': '9b85793c-a6bc-44a6-8692-4281b66fbcf3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:41.193267 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.215113 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:41.221825 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Usage tracker for resource:security_group_rule and tenant:daa03182913d495bb1374793aaa6d748 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:41.249091 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:41.266575 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:41.301420 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.423944 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2332920', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2577448'] for subnet, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.442583 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-159a0287-2409-4152-ac07-ab60035b0ef8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:41.477032 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fef053b-ef98-4aa9-beaf-625d92c6ff38 req-ee95cf85-02a8-44a5-88a7-4c69b664a463 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:41.478574 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8fef053b-ef98-4aa9-beaf-625d92c6ff38 req-ee95cf85-02a8-44a5-88a7-4c69b664a463 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.6365478 May 26 14:43:41.495602 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.510234 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.513084 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf61a2e-81cb-4345-b14c-37611258f2d6 req-905996fb-5310-442a-8c12-2a074d2256ec tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:41.514544 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-daf61a2e-81cb-4345-b14c-37611258f2d6 req-905996fb-5310-442a-8c12-2a074d2256ec tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.4866331 May 26 14:43:41.516600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=29dd1fff-ba1d-46d0-b132-d9d306dbfa6d,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:41.519636 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d9e6ba24-c28f-4782-8dec-c9a1ab08eb5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:41.522348 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.548548 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.548982 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.549528 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.549647 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.549995 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.550344 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.550782 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.551030 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.551350 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.551697 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.552011 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.552341 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:41.577285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:41.616361 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=daa03182913d495bb1374793aaa6d748&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4588201 May 26 14:43:41.622651 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39370) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:41.636800 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4fdc397-a40c-428b-b1d3-8b0164a02492,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:41.642489 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:41.653289 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/29dd1fff-ba1d-46d0-b132-d9d306dbfa6d HTTP/1.1" status: 204 len: 168 time: 1.5291228 May 26 14:43:41.654054 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39374) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:41.714902 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-daf61a2e-81cb-4345-b14c-37611258f2d6 req-9ad8ea52-3895-41a2-aa80-05651b86caa3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1787140 May 26 14:43:41.728115 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-20a12097-639e-4648-8dd8-32c5eb6fa5dc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.772575 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8fef053b-ef98-4aa9-beaf-625d92c6ff38 req-d5327dde-715d-4e4c-93bf-3fcba9a51051 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2781565 May 26 14:43:41.819080 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-20a12097-639e-4648-8dd8-32c5eb6fa5dc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.845797 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2e45fc02-4af4-4423-b131-3a6415bee331 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:41.862719 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.883757 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Transition to ACTIVE for port object 2e45fc02-4af4-4423-b131-3a6415bee331 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:41.892537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:41.898451 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4c9bd44f-baaa-43d4-9264-de07d201e633 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:41.958663 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-20a12097-639e-4648-8dd8-32c5eb6fa5dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.045575 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.047576 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Pushing event updated for resources: {'Port': ['ID=2e45fc02-4af4-4423-b131-3a6415bee331,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:42.052398 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:42.052974 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.039s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:42.092121 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-20a12097-639e-4648-8dd8-32c5eb6fa5dc admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.093223 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-20a12097-639e-4648-8dd8-32c5eb6fa5dc admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a4fdc397-a40c-428b-b1d3-8b0164a02492 HTTP/1.1" status: 204 len: 168 time: 0.4696729 May 26 14:43:42.123980 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a12097-639e-4648-8dd8-32c5eb6fa5dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4fdc397-a40c-428b-b1d3-8b0164a02492,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:42.128518 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-20a12097-639e-4648-8dd8-32c5eb6fa5dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:42.140774 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-25db0a12-9501-49d5-9782-e1958848ac3a req-11c99b69-32f0-4544-bd9d-e33b2716907c tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] 10.222.0.72 "GET /v2.0/ports?device_id=0d70a460-f327-420d-902a-7e26b59453d5 HTTP/1.1" status: 200 len: 210 time: 0.0860410 May 26 14:43:42.181086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Attempting to bind port 2e45fc02-4af4-4423-b131-3a6415bee331 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:42.181431 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Attempting to bind port 2e45fc02-4af4-4423-b131-3a6415bee331 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:42.181755 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Attempting to bind port 2e45fc02-4af4-4423-b131-3a6415bee331 on network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:42.186553 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Port 2e45fc02-4af4-4423-b131-3a6415bee331 on network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:43:42.186983 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Attempting to bind port 2e45fc02-4af4-4423-b131-3a6415bee331 on network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:42.192414 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:42.192767 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Checking segment: {'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:42.193175 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Bound using segment: {'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:42.193621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Bound port: 2e45fc02-4af4-4423-b131-3a6415bee331, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:42.193987 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.295542 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] For port 2e45fc02-4af4-4423-b131-3a6415bee331, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:42.301972 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] For port 2e45fc02-4af4-4423-b131-3a6415bee331, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=2e45fc02-4af4-4423-b131-3a6415bee331,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:42.312779 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.320604 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.326868 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:42.336966 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['70f24af3-66c4-46fe-9f15-8e6f5cb31591']}} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:42.393758 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cfb6191-9cfc-46e2-98c1-0c6b08be1ce5 req-f0f2e072-217c-4249-93ce-55d1928678f5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:42.400851 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9cfb6191-9cfc-46e2-98c1-0c6b08be1ce5 req-f0f2e072-217c-4249-93ce-55d1928678f5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 943 time: 0.5369976 May 26 14:43:42.408169 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fbeddf74-3241-418f-ad37-e4f2651836c5') {'for_net_delete': True} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:42.408454 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fbeddf74-3241-418f-ad37-e4f2651836c5') {} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:42.408920 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Pushing event updated for resources: {'Port': ['ID=2e45fc02-4af4-4423-b131-3a6415bee331,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:42.413868 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:42.417593 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:42.418848 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.420871 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] 10.222.0.79 "PUT /v2.0/ports/2e45fc02-4af4-4423-b131-3a6415bee331 HTTP/1.1" status: 200 len: 1093 time: 1.2932611 May 26 14:43:42.421738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9b85793c-a6bc-44a6-8692-4281b66fbcf3', 'tag': '2e45fc02-4af4-4423-b131-3a6415bee331'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:42.444639 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2677883'] for segment, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.467970 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.db.resource_extend [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 26 14:43:42.490981 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9b85793c-a6bc-44a6-8692-4281b66fbcf3', 'tag': '2e45fc02-4af4-4423-b131-3a6415bee331', 'status': 'completed', 'code': 200} May 26 14:43:42.541772 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.557266 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9cfb6191-9cfc-46e2-98c1-0c6b08be1ce5 req-5b85c0c4-8af6-4889-a695-31ee00dc9e46 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1555650 May 26 14:43:42.562102 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Releasing vlan 1133 on physical network physnet1 to pool {{(pid=98445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:43:42.562524 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2334298'] for segment, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: Traceback (most recent call last): May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: timer() May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: cb(*args, **kw) May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: return func(*args, **kwargs) May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: self._notify() May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: self.callback(batched_events) May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: event.method(event) May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: return f(self, *a, **k) May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._get(url).json() May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: return self.request(url, 'GET', **kwargs) May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:43:42.576083 dv-cinder-774594-6-iscsi neutron-server[98445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:43:42.633424 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 9650b7e0-6b25-419e-8a24-02c267172949 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:43:42.662536 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.669185 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.674594 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2c13bce7-25de-41bf-a629-b576ab918fc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:42.676207 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-2c13bce7-25de-41bf-a629-b576ab918fc1 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=1a5c67cf2b5f455180b60afe8233d534&device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 1096 time: 0.1281800 May 26 14:43:42.687138 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 9650b7e0-6b25-419e-8a24-02c267172949 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:43:42.687483 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 9650b7e0-6b25-419e-8a24-02c267172949 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:43:42.788166 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-3dc96783-999a-433a-a15b-0732da293dbd service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2e45fc02-4af4-4423-b131-3a6415bee331 HTTP/1.1" status: 200 len: 217 time: 0.0714755 May 26 14:43:42.822946 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.845570 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:42.872635 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:42.877858 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Pushing event deleted for resources: {'Network': ['ID=70f24af3-66c4-46fe-9f15-8e6f5cb31591,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:42.902667 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-88198b9d-a7ab-4ce7-868f-2804357775f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:42.912133 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-88198b9d-a7ab-4ce7-868f-2804357775f3 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=12c3a6cc-90f7-4a24-9389-58ed3aa06051 HTTP/1.1" status: 200 len: 849 time: 0.1104732 May 26 14:43:42.933926 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:42.975246 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-ec1c283c-04fe-4c5e-aa29-7c5d0cf66650 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0505302 May 26 14:43:43.002120 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-cf14bd94-f634-4507-937d-155fe6e05814 admin admin] 10.222.0.72 "DELETE /v2.0/networks/70f24af3-66c4-46fe-9f15-8e6f5cb31591 HTTP/1.1" status: 204 len: 168 time: 1.3369269 May 26 14:43:43.003855 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39408) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:43.070758 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.l3_db [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Floating IP 986379f1-3866-4361-8ca4-51d02f9acf86 associated. External IP: 172.27.3.98, port: 8553a1c9-db24-4d4f-8d37-0a358f73ac23. May 26 14:43:43.250786 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Deleting subnet edab1676-91d4-4f83-8cb4-513820bbc590 {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:43:43.269687 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375fa424-da89-4664-a8bb-313af3e2d2cb req-3465cdca-f07b-4a6d-8d82-51626f903b1c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:43.271231 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-375fa424-da89-4664-a8bb-313af3e2d2cb req-3465cdca-f07b-4a6d-8d82-51626f903b1c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.3415511 May 26 14:43:43.283765 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fc3ded-beca-4599-9cdf-dfaf1ebbf9d8 req-0d489fb5-a362-46db-8529-11a0d3663500 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:43.285218 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-10fc3ded-beca-4599-9cdf-dfaf1ebbf9d8 req-0d489fb5-a362-46db-8529-11a0d3663500 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.3537498 May 26 14:43:43.297361 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-fd4b4deb-8dfa-404a-8c2e-3e18341858d4 service neutron] 10.222.0.79 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3129578 May 26 14:43:43.299638 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:43.428481 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:43.430616 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-375fa424-da89-4664-a8bb-313af3e2d2cb req-8f318918-99ac-4e63-8654-80256617c7a8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1442664 May 26 14:43:43.448025 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-10fc3ded-beca-4599-9cdf-dfaf1ebbf9d8 req-812076a3-8ef0-4de6-b843-5ca4062b749c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1408732 May 26 14:43:43.572692 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:43.591516 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Router f62ef884-b65a-487d-8955-15d95245398f has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:43:43.759091 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bd3f2b80-c410-42c3-a4a7-c8df28d5e081 req-e1326592-d058-47ec-9361-ca6c40c00aa9 service neutron] 10.222.0.79 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4164572 May 26 14:43:43.971358 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:43:43.987846 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] Sync routers for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:43:43.991655 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.016016 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:44.016656 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:44.094995 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.115254 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:44.153777 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-0ddbc818-3f3b-40ab-a5b9-938275eb51c4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "PUT /v2.0/floatingips/986379f1-3866-4361-8ca4-51d02f9acf86 HTTP/1.1" status: 200 len: 991 time: 3.4117754 May 26 14:43:44.160644 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:44.179897 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=edab1676-91d4-4f83-8cb4-513820bbc590,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:44.190540 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9914860-eeda-4fce-8959-f3513907225c req-8a30485c-3547-4366-9439-45d4a55f2272 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:44.190871 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:44.192204 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b9914860-eeda-4fce-8959-f3513907225c req-8a30485c-3547-4366-9439-45d4a55f2272 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.5938578 May 26 14:43:44.204812 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.207552 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39456) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:44.224809 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'floatingip': {'port_id': '0ecd487f-30b4-4cc4-b331-76c06312e6b0'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:44.227620 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-b2c5a28e-32b9-4694-8d22-94a993c05f36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:44.229442 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-b2c5a28e-32b9-4694-8d22-94a993c05f36 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=1a5c67cf2b5f455180b60afe8233d534&device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 1096 time: 0.2932899 May 26 14:43:44.235519 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/edab1676-91d4-4f83-8cb4-513820bbc590 HTTP/1.1" status: 204 len: 168 time: 1.2307231 May 26 14:43:44.238769 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39460) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:44.276667 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:44.512552 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-25fd6ab7-a793-4662-9116-f7b42ee502d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:44.514056 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-25fd6ab7-a793-4662-9116-f7b42ee502d1 service neutron] 10.222.0.79 "GET /v2.0/networks?id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837 HTTP/1.1" status: 200 len: 911 time: 0.2433603 May 26 14:43:44.604691 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.605679 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.608295 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-4d68f10e-1648-4abd-bcbd-e610f4026422 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2e45fc02-4af4-4423-b131-3a6415bee331 HTTP/1.1" status: 200 len: 217 time: 0.0735090 May 26 14:43:44.677229 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da8aa52-1cc0-4acc-91a6-93aeef7276cd req-53a6889e-325c-41b5-a03b-79db5f97876b tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:44.679086 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9da8aa52-1cc0-4acc-91a6-93aeef7276cd req-53a6889e-325c-41b5-a03b-79db5f97876b tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 943 time: 0.7947743 May 26 14:43:44.695278 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '986379f1-3866-4361-8ca4-51d02f9acf86', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'floating_ip_address': '172.27.3.98', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'port_id': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'mac_address': 'fa:16:3e:1e:15:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:43:11Z', 'updated_at': '2021-05-26T14:43:42Z', 'revision_number': 1, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:44.702738 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] Checking router: f62ef884-b65a-487d-8955-15d95245398f for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:43:44.714978 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:44.715978 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:44.801486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.815464 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8b295999-8ceb-4c41-a27c-38d1d8bea4c3']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:44.828052 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3f7966c1-cf34-4e3b-abf7-92e4f64f4739') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:44.828347 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3f7966c1-cf34-4e3b-abf7-92e4f64f4739') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:44.841055 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.858817 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.865660 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Releasing vlan 1129 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:43:44.866059 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.903623 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-680c3601-a0cf-454c-8a47-34efa8af0e5c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:44.905207 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-680c3601-a0cf-454c-8a47-34efa8af0e5c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 813 time: 0.5648446 May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:43:44.969340 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:43:44.989197 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:44.992198 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-525825ff-c708-491a-bfa2-d768df70831d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:44.993353 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-525825ff-c708-491a-bfa2-d768df70831d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=12c3a6cc-90f7-4a24-9389-58ed3aa06051 HTTP/1.1" status: 200 len: 849 time: 0.3464243 May 26 14:43:44.994074 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:44.996869 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:45.000902 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9da8aa52-1cc0-4acc-91a6-93aeef7276cd req-185589be-b5b2-44f0-b09b-f6b190ef3b9a tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2997773 May 26 14:43:45.013968 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:45.030856 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-881b43c1-a6e7-4159-8045-ede9e4b9f5cb tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/quotas/3159eb22d2eb468e967fa04761ae0331 HTTP/1.1" status: 200 len: 375 time: 0.0573199 May 26 14:43:45.068916 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Pushing event deleted for resources: {'Network': ['ID=8b295999-8ceb-4c41-a27c-38d1d8bea4c3,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:45.078027 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-c958c71a-6f12-41c4-836e-9815af65aebb service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0589507 May 26 14:43:45.079009 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:45.080819 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] 10.222.0.72 "DELETE /v2.0/networks/8b295999-8ceb-4c41-a27c-38d1d8bea4c3 HTTP/1.1" status: 204 len: 168 time: 0.8408408 May 26 14:43:45.300854 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'status': 'completed', 'code': 200} May 26 14:43:45.370748 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39484) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:45.391523 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-884b1b82-c43c-48fe-8346-b47a8eaf1475 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3473322 May 26 14:43:45.443772 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-58038b3b-b0df-4883-bb07-384815d36c53 service neutron] 10.222.0.79 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3572316 May 26 14:43:45.482826 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e99e5ced-6ed8-4375-986a-a50c6b7c30da admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=3d072d680b644e9e93fdb4a47b31e960&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1080348 May 26 14:43:45.483888 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39490) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:45.490645 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '986379f1-3866-4361-8ca4-51d02f9acf86', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'floating_ip_address': '172.27.3.98', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'port_id': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'mac_address': 'fa:16:3e:1e:15:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:43:11Z', 'updated_at': '2021-05-26T14:43:42Z', 'revision_number': 1, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:45.495098 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a720f198-9c9f-463d-988f-be9b23f73b28 None None] The sync data for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi is: [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '986379f1-3866-4361-8ca4-51d02f9acf86', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'floating_ip_address': '172.27.3.98', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'port_id': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 144, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'mac_address': 'fa:16:3e:1e:15:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:43:11Z', 'updated_at': '2021-05-26T14:43:42Z', 'revision_number': 1, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:43:45.639161 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-25cd25d4-f21a-47b3-8f99-c55c7c6d43a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:45.650685 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f2793523-3b90-4754-8f6b-a0fcba7b2371 req-54b22349-8991-4fa9-869b-5eaa7e3d9911 service neutron] 10.222.0.79 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1943407 May 26 14:43:45.668432 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-25cd25d4-f21a-47b3-8f99-c55c7c6d43a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:45.689268 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-bd04566d-15c1-4002-bfae-be834f7733a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:45.690829 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-bd04566d-15c1-4002-bfae-be834f7733a0 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 1099 time: 0.3648624 May 26 14:43:45.728818 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-25cd25d4-f21a-47b3-8f99-c55c7c6d43a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:45.733299 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:45.747212 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44a13e6c-d945-4725-810a-e040236687e7 None None] New status for floating IP 986379f1-3866-4361-8ca4-51d02f9acf86: ACTIVE {{(pid=98446) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:43:45.749711 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25cd25d4-f21a-47b3-8f99-c55c7c6d43a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa9d3cea-662b-491c-9917-ca1cff4fa8b2,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:45.752153 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-25cd25d4-f21a-47b3-8f99-c55c7c6d43a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:45.758362 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-25cd25d4-f21a-47b3-8f99-c55c7c6d43a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:45.762047 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-25cd25d4-f21a-47b3-8f99-c55c7c6d43a2 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/fa9d3cea-662b-491c-9917-ca1cff4fa8b2 HTTP/1.1" status: 204 len: 168 time: 0.2747881 May 26 14:43:45.800470 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-5cd9d2e0-7892-4227-a24e-53f8747c4f6c service neutron] 10.222.0.72 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3332918 May 26 14:43:45.860311 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96531127-1ba9-496f-a0e0-3bd77bece78d req-020b78df-1912-44fe-b659-40095f593f3e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:45.870197 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-96531127-1ba9-496f-a0e0-3bd77bece78d req-020b78df-1912-44fe-b659-40095f593f3e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.3854120 May 26 14:43:45.994113 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.db.resource_extend [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 26 14:43:46.106991 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-64073b5a-597c-4f3a-bde0-9b808afbffa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:46.108594 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-64073b5a-597c-4f3a-bde0-9b808afbffa2 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.4083636 May 26 14:43:46.179763 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-96531127-1ba9-496f-a0e0-3bd77bece78d req-905d7ec7-202b-4212-b9a8-495f5c2b243c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3113115 May 26 14:43:46.191161 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39506) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:46.247955 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-4756c016-83ca-4767-b9e0-a0bcacdb66e9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=6a1ea03fc5dd43edba5586636771c812&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0530398 May 26 14:43:46.248128 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:46.248128 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-cf57dbad-0893-42da-a2e2-64b0452e3817 service neutron] 10.222.0.72 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4345412 May 26 14:43:46.256400 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39512) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:46.273344 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:46.559396 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-1f2d776b-4dc9-44fe-b049-c1c95e17ac5e service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23 HTTP/1.1" status: 200 len: 1001 time: 0.4382298 May 26 14:43:46.642422 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 2e45fc02-4af4-4423-b131-3a6415bee331 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:43:46.690787 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39532) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:46.729320 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.l3_db [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Floating IP 79494d40-36bf-43b0-96dc-800598e41e2f associated. External IP: 172.27.3.238, port: 0ecd487f-30b4-4cc4-b331-76c06312e6b0. May 26 14:43:46.820658 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Deleting subnet 20c9d993-accf-4e4f-9a65-8f9e0b42e9b4 {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:43:46.825251 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:46.881737 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-44e3713a-ed4b-440a-92c6-a831b104fd7c req-fe6fa632-72e9-40e8-84a4-3bb6501767d5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 210 time: 0.0777314 May 26 14:43:46.888746 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:46.891285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7ce7aeca-539d-4277-bd36-9c30b20c2737 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:46.893572 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 2e45fc02-4af4-4423-b131-3a6415bee331, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=2e45fc02-4af4-4423-b131-3a6415bee331,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:46.908908 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '2e45fc02-4af4-4423-b131-3a6415bee331', 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837', 'port_id': '2e45fc02-4af4-4423-b131-3a6415bee331', 'mac_address': 'fa:16:3e:b5:ab:4c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12c3a6cc-90f7-4a24-9389-58ed3aa06051', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:43:46.953135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:46.957478 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-f28145d3-430c-4654-9199-e9d51fe87f73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:46.958989 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-f28145d3-430c-4654-9199-e9d51fe87f73 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.3847528 May 26 14:43:46.961283 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7ce7aeca-539d-4277-bd36-9c30b20c2737 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:46.974248 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:46.980015 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54584c9c-b0ee-418d-a615-61b948307d60 req-59304238-7592-4e25-8402-e1beec43966b tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:46.987089 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-54584c9c-b0ee-418d-a615-61b948307d60 req-59304238-7592-4e25-8402-e1beec43966b tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 943 time: 0.5263972 May 26 14:43:46.992754 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2e45fc02-4af4-4423-b131-3a6415bee331 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:47.011461 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 2e45fc02-4af4-4423-b131-3a6415bee331, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=2e45fc02-4af4-4423-b131-3a6415bee331,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:47.018114 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.020648 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:47.097201 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=2e45fc02-4af4-4423-b131-3a6415bee331,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:47.109805 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.110142 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.111170 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.111502 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.111827 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.112151 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.112503 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.112879 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.114180 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.114180 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.114180 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.114180 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:43:47.118435 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:47.198899 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-54584c9c-b0ee-418d-a615-61b948307d60 req-a064ff47-3fd1-4337-8b84-7c79ca9c2ccc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2109320 May 26 14:43:47.247924 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.253163 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-493abdbc-6895-4dce-a5ed-94ab0bfdb513 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:47.288455 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=20c9d993-accf-4e4f-9a65-8f9e0b42e9b4,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:47.295401 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:47.296457 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.302700 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/20c9d993-accf-4e4f-9a65-8f9e0b42e9b4 HTTP/1.1" status: 204 len: 168 time: 0.6106324 May 26 14:43:47.305045 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39540) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:47.319488 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7ce7aeca-539d-4277-bd36-9c30b20c2737 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.329184 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1b98a496-7904-45ce-8921-c1a2b9cbff45 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:47.361004 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ce7aeca-539d-4277-bd36-9c30b20c2737 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e93d614d-f4ac-4152-97aa-4e65f7e857a7,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:47.363613 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7ce7aeca-539d-4277-bd36-9c30b20c2737 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:47.399406 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-6a975aac-46a5-4835-b135-ef407a811134 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:47.400925 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-6a975aac-46a5-4835-b135-ef407a811134 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.4072900 May 26 14:43:47.414990 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.452168 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['2e45fc02-4af4-4423-b131-3a6415bee331'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:47.464821 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7ce7aeca-539d-4277-bd36-9c30b20c2737 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.468463 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-7ce7aeca-539d-4277-bd36-9c30b20c2737 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/e93d614d-f4ac-4152-97aa-4e65f7e857a7 HTTP/1.1" status: 204 len: 168 time: 1.2083731 May 26 14:43:47.557875 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.582463 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['49db6557-68a4-49ce-b847-46383a000b41']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:47.596969 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3932bf42-877e-4f90-8f96-afdb4108b51c') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:47.597260 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3932bf42-877e-4f90-8f96-afdb4108b51c') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:47.613592 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.621644 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Router 3865f36a-0ff1-4ceb-997f-e7f4306675ef has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:43:47.634286 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.642042 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Releasing vlan 1132 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:43:47.642469 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.726270 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-4b9be724-9b39-42bc-8a45-1ab71e3cbbcd service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2590599 May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:43:47.731478 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:43:47.746842 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08fd0af7-0d69-419c-892e-f55cddb2363e req-c83100e1-adfe-4e6e-8956-a31580684bae tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:47.748466 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-08fd0af7-0d69-419c-892e-f55cddb2363e req-c83100e1-adfe-4e6e-8956-a31580684bae tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.3971415 May 26 14:43:47.778629 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.782156 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:47.800742 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:47.810349 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Pushing event deleted for resources: {'Network': ['ID=49db6557-68a4-49ce-b847-46383a000b41,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:47.813297 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:47.833558 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-1a7af45a-3d82-411e-baf3-50a8b5eb9cae admin admin] 10.222.0.72 "DELETE /v2.0/networks/49db6557-68a4-49ce-b847-46383a000b41 HTTP/1.1" status: 204 len: 168 time: 0.5145555 May 26 14:43:47.962855 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-08fd0af7-0d69-419c-892e-f55cddb2363e req-475487ff-0a8e-4060-830c-ebd6174b4764 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2077916 May 26 14:43:48.167373 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39566) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:48.174845 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:43:48.186985 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] Sync routers for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:43:48.197758 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:48.198638 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:48.247010 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-bea29a4c-2491-4fd8-9ce5-deb3d366e290 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:48.258888 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2b328f24-d1db-4010-a3ef-fd48a7c94de3 req-6620dd5a-7907-4488-aa06-b3ddf5b3793c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 210 time: 0.0875802 May 26 14:43:48.260602 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-bea29a4c-2491-4fd8-9ce5-deb3d366e290 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 813 time: 0.3014615 May 26 14:43:48.263099 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:48.284548 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Request body: {'port': {'device_id': '45acbebb-b7dd-48a6-89ee-c5e0b057813f', 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'admin_state_up': True, 'tenant_id': '3159eb22d2eb468e967fa04761ae0331'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:48.406592 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:48.493919 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ec018b6-cb05-4d4f-953f-f81acf6625e8 req-038cae2d-ddf3-4e8d-94c8-dd5803812e14 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6703048 May 26 14:43:48.504065 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e082e1f7-ad50-4d0e-9210-7abcdc8b690f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=57f47a57c1814dd283e52c17dfcb8649&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3346591 May 26 14:43:48.515307 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-49386b13-f9c2-4cc5-a7aa-2a40422241e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "PUT /v2.0/floatingips/79494d40-36bf-43b0-96dc-800598e41e2f HTTP/1.1" status: 200 len: 991 time: 4.3058164 May 26 14:43:48.516106 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39578) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:48.516944 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'tag': '0ecd487f-30b4-4cc4-b331-76c06312e6b0'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:48.650093 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 2e45fc02-4af4-4423-b131-3a6415bee331 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:43:48.679436 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ce1178-5cd2-4130-ba34-6b4a5c26c020 req-ecc237ff-03da-4a2d-82bc-eb52930490ad tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:48.687951 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-88ce1178-5cd2-4130-ba34-6b4a5c26c020 req-ecc237ff-03da-4a2d-82bc-eb52930490ad tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 944 time: 0.2378900 May 26 14:43:48.690692 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-24ccf045-6679-4697-92b6-e321868bb055 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:48.710555 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:48.715476 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Usage tracker for resource:port and tenant:3159eb22d2eb468e967fa04761ae0331 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:48.719257 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Quota usage for port was recalculated. Used quota:1. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:48.726212 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:48.742117 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Made reservation on behalf of 3159eb22d2eb468e967fa04761ae0331 for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:43:48.747273 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:48.778674 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-24ccf045-6679-4697-92b6-e321868bb055 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:48.799546 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 2e45fc02-4af4-4423-b131-3a6415bee331 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:43:48.805275 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-88ce1178-5cd2-4130-ba34-6b4a5c26c020 req-af24f515-843e-4371-94ff-39182ddd3d1a tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1162844 May 26 14:43:48.806843 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 2e45fc02-4af4-4423-b131-3a6415bee331 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:43:48.807402 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:48.891610 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-24ccf045-6679-4697-92b6-e321868bb055 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:48.897483 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-8d1a3bac-5c8f-4759-b314-e333ac639cf1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:48.929910 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ccf045-6679-4697-92b6-e321868bb055 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ecb5754d-a6d1-43a1-82d0-25cec65d5699,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:48.933006 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'tag': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'status': 'completed', 'code': 200} May 26 14:43:48.938697 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-24ccf045-6679-4697-92b6-e321868bb055 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:48.939933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-24ccf045-6679-4697-92b6-e321868bb055 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:48.967841 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-24ccf045-6679-4697-92b6-e321868bb055 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/ecb5754d-a6d1-43a1-82d0-25cec65d5699 HTTP/1.1" status: 204 len: 168 time: 0.4373813 May 26 14:43:49.045501 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Allocated IP 172.20.0.4 (c6d63b53-7bae-4cfb-ac0b-4643c0894395/e482f08e-dc41-4d58-b9cf-6de9798b0585/c15a8128-db77-479e-9b42-25276139f049) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:43:49.196805 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-3f978fb4-fe0b-4b19-ab20-02c55232e0eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:49.198437 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-3f978fb4-fe0b-4b19-ab20-02c55232e0eb service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 1098 time: 0.2195258 May 26 14:43:49.198563 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '79494d40-36bf-43b0-96dc-800598e41e2f', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'floating_ip_address': '172.27.3.238', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'port_id': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 164, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'mac_address': 'fa:16:3e:74:5b:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:43:16Z', 'updated_at': '2021-05-26T14:43:45Z', 'revision_number': 1, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:49.211369 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] Checking router: 3865f36a-0ff1-4ceb-997f-e7f4306675ef for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:43:49.213488 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:49.231643 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:43:49.232273 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:49.247639 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b85793c-a6bc-44a6-8692-4281b66fbcf3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2e45fc02-4af4-4423-b131-3a6415bee331'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:49.277241 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 2e45fc02-4af4-4423-b131-3a6415bee331, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=2e45fc02-4af4-4423-b131-3a6415bee331,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:49.284041 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:49.286256 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:49.341538 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9b85793c-a6bc-44a6-8692-4281b66fbcf3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2e45fc02-4af4-4423-b131-3a6415bee331', 'code': 200} May 26 14:43:49.384489 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=2e45fc02-4af4-4423-b131-3a6415bee331,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:49.390847 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:49.510993 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-9b9676a8-dd98-43c0-bdd2-185ed55388e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:49.512633 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-9b9676a8-dd98-43c0-bdd2-185ed55388e5 service neutron] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 913 time: 0.3064349 May 26 14:43:49.531724 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:49.543162 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:43:49.588714 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:49.600540 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:49.638511 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ec4ee3ea-9d36-4c14-a225-a3445629295c'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:49.803309 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-e188edab-4194-4b27-89d8-a12b5ec8b82c service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0 HTTP/1.1" status: 200 len: 999 time: 0.2468445 May 26 14:43:49.808980 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Network c6d63b53-7bae-4cfb-ac0b-4643c0894395 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:43:49.835012 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:43:49.850881 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Pushing event updated for resources: {'Port': ['ID=c15a8128-db77-479e-9b42-25276139f049,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:49.863451 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:43:49.874567 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b991c8c2-766f-4f2b-983d-4acf2a5e2671 req-1931a9fd-c297-4961-b805-a4f0175416b0 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:49.881695 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b991c8c2-766f-4f2b-983d-4acf2a5e2671 req-1931a9fd-c297-4961-b805-a4f0175416b0 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.3675108 May 26 14:43:49.953403 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-0421bdd3-0f0f-4ee9-8d49-9aa16dfee01b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:49.955019 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-0421bdd3-0f0f-4ee9-8d49-9aa16dfee01b service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.1404679 May 26 14:43:49.956861 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.356s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:49.967637 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d35e81d-348b-487f-b6a0-74442505d797 req-01259d44-6cec-4ab6-8ee4-5dc42edd5a01 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:49.969178 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7d35e81d-348b-487f-b6a0-74442505d797 req-01259d44-6cec-4ab6-8ee4-5dc42edd5a01 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 931 time: 0.3590164 May 26 14:43:50.057166 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b991c8c2-766f-4f2b-983d-4acf2a5e2671 req-a4479b9b-ca82-4f8d-b24f-40164e1a56b1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1744316 May 26 14:43:50.060550 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:50.061628 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:50.114922 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae444f6-9479-406b-a739-5b632057a652 req-4e5133ec-10e1-4565-859c-c05c7e0db7a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:50.122073 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3ae444f6-9479-406b-a739-5b632057a652 req-4e5133ec-10e1-4565-859c-c05c7e0db7a0 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 1098 time: 0.4127758 May 26 14:43:50.123854 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8442895 May 26 14:43:50.131874 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7d35e81d-348b-487f-b6a0-74442505d797 req-b6c6bac1-22da-4dc2-ad25-c449cd1d1d7f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1196544 May 26 14:43:50.163415 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-6b983b17-b513-4d48-87d8-533eb88e8cc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:50.164979 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-6b983b17-b513-4d48-87d8-533eb88e8cc2 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1919053 May 26 14:43:50.197812 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Request body: {'port': {'device_id': '45acbebb-b7dd-48a6-89ee-c5e0b057813f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:43:50.425451 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '79494d40-36bf-43b0-96dc-800598e41e2f', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'floating_ip_address': '172.27.3.238', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'port_id': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 164, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'mac_address': 'fa:16:3e:74:5b:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:43:16Z', 'updated_at': '2021-05-26T14:43:45Z', 'revision_number': 1, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:43:50.436284 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a58f2e26-39e4-4b85-b93f-b32eca7150db None None] The sync data for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi is: [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '79494d40-36bf-43b0-96dc-800598e41e2f', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'floating_ip_address': '172.27.3.238', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'port_id': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 164, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'mac_address': 'fa:16:3e:74:5b:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:43:16Z', 'updated_at': '2021-05-26T14:43:45Z', 'revision_number': 1, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:43:50.470729 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3ae444f6-9479-406b-a739-5b632057a652 req-3293f41e-d68c-451a-b5bd-19a318f47d7e service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3220589 May 26 14:43:50.543258 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:50.567568 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-d64464ad-de1d-49fa-8c34-6dcedbb6d8c7 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3846493 May 26 14:43:50.580188 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82ba969-96ed-4d41-afcb-91a82118d801 req-7471ecc4-0f2a-44c4-904f-cb287c90dfa0 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:50.588006 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e82ba969-96ed-4d41-afcb-91a82118d801 req-7471ecc4-0f2a-44c4-904f-cb287c90dfa0 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 945 time: 0.2176135 May 26 14:43:50.636994 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e82ba969-96ed-4d41-afcb-91a82118d801 req-377e4b9b-1764-45a9-8126-cb4e57a054bf tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480380 May 26 14:43:50.762340 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e6627c9-5ea0-4db0-aa20-01c88b546462 None None] New status for floating IP 79494d40-36bf-43b0-96dc-800598e41e2f: ACTIVE {{(pid=98446) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:43:51.000438 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b259afa2-882f-4f14-b2f5-06595c24b954 req-64784b1e-ffe1-446d-8fac-eeb90d6a46b0 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1862571 May 26 14:43:51.152748 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c15a8128-db77-479e-9b42-25276139f049 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:51.180523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:51.199071 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Transition to ACTIVE for port object c15a8128-db77-479e-9b42-25276139f049 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:43:51.204582 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:51.212870 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:51.343913 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8beaa5-8c92-4d3a-a61b-a573df8d0a39 req-72b4b6e7-72ba-4c09-b9d3-4f00f4319e43 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:51.351236 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7b8beaa5-8c92-4d3a-a61b-a573df8d0a39 req-72b4b6e7-72ba-4c09-b9d3-4f00f4319e43 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1033521 May 26 14:43:51.407575 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7b8beaa5-8c92-4d3a-a61b-a573df8d0a39 req-b696fe7f-a9e1-46c2-8389-dc1d6300c34d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551476 May 26 14:43:51.422565 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Pushing event updated for resources: {'Port': ['ID=c15a8128-db77-479e-9b42-25276139f049,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:51.431071 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:51.522348 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Attempting to bind port c15a8128-db77-479e-9b42-25276139f049 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:43:51.524644 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Attempting to bind port c15a8128-db77-479e-9b42-25276139f049 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:43:51.526142 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Attempting to bind port c15a8128-db77-479e-9b42-25276139f049 on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:51.535936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Port c15a8128-db77-479e-9b42-25276139f049 on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:43:51.538786 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Attempting to bind port c15a8128-db77-479e-9b42-25276139f049 on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:43:51.555029 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:43:51.557756 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Checking segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:43:51.558216 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Bound using segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:43:51.558890 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Bound port: c15a8128-db77-479e-9b42-25276139f049, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:43:51.559331 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:51.626777 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-6777d60a-d375-4a47-9cff-24c763448d7d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:51.640336 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38af4aa-1e32-478f-926e-f3785218e194 req-ecb2e9ff-7ac0-456e-975f-3f4d9003a534 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:51.650818 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c38af4aa-1e32-478f-926e-f3785218e194 req-ecb2e9ff-7ac0-456e-975f-3f4d9003a534 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 943 time: 0.1168437 May 26 14:43:51.699987 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] For port c15a8128-db77-479e-9b42-25276139f049, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:43:51.700977 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c38af4aa-1e32-478f-926e-f3785218e194 req-53005f06-c279-4685-b0b6-b75b5a32fc3d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432420 May 26 14:43:51.704406 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] For port c15a8128-db77-479e-9b42-25276139f049, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=c15a8128-db77-479e-9b42-25276139f049,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:43:51.712537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:51.718410 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:51.781362 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:51.781625 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:51.783016 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] 10.222.0.79 "PUT /v2.0/ports/c15a8128-db77-479e-9b42-25276139f049 HTTP/1.1" status: 200 len: 1093 time: 1.5962031 May 26 14:43:51.783535 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45acbebb-b7dd-48a6-89ee-c5e0b057813f', 'tag': 'c15a8128-db77-479e-9b42-25276139f049'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:43:51.804287 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Pushing event updated for resources: {'Port': ['ID=c15a8128-db77-479e-9b42-25276139f049,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:51.808537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:52.044920 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45acbebb-b7dd-48a6-89ee-c5e0b057813f', 'tag': 'c15a8128-db77-479e-9b42-25276139f049', 'status': 'completed', 'code': 200} May 26 14:43:52.097522 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-977e8e43-1c1f-4b7c-a02f-f80405c2f8d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:52.100065 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-977e8e43-1c1f-4b7c-a02f-f80405c2f8d3 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 1096 time: 0.0985227 May 26 14:43:52.121068 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-173ec6b1-36ce-4edb-9cdd-c5fcb40fc76e req-5642cb02-4c3d-4aee-a22e-0aebc179a105 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:52.122649 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-173ec6b1-36ce-4edb-9cdd-c5fcb40fc76e req-5642cb02-4c3d-4aee-a22e-0aebc179a105 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 945 time: 0.1191683 May 26 14:43:52.274540 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-173ec6b1-36ce-4edb-9cdd-c5fcb40fc76e req-d8e47c6d-8025-4411-a75b-dcfb137219bb tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1448390 May 26 14:43:52.329517 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-586c2e90-10ac-44ef-a882-1ccfd7f5fe3a service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c15a8128-db77-479e-9b42-25276139f049 HTTP/1.1" status: 200 len: 217 time: 0.1412816 May 26 14:43:52.480952 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-fc245f06-779f-4152-b2eb-bb56c89a69e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:52.482600 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-fc245f06-779f-4152-b2eb-bb56c89a69e3 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.0603585 May 26 14:43:52.563660 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-4b7349be-7d3e-4bcb-ac0e-2925d08cbc73 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0485277 May 26 14:43:52.728216 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-24f688b5-e195-4c0c-8c1c-f5625ba597e7 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1514688 May 26 14:43:52.765482 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef60312-9a13-400f-9283-707cd26e0387 req-740f27ec-1d81-492e-afb6-a3f90197c480 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:52.767198 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5ef60312-9a13-400f-9283-707cd26e0387 req-740f27ec-1d81-492e-afb6-a3f90197c480 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1131222 May 26 14:43:52.902796 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b1eb46e2-e3a4-417b-bf52-9ca0416e924d req-89ff17a9-d1ab-49bb-b780-b526ed80439b service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1651058 May 26 14:43:52.926391 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5ef60312-9a13-400f-9283-707cd26e0387 req-1af6ac8e-8740-4972-b026-5e7239b2033f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1506062 May 26 14:43:52.958140 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b350773d-a81a-4823-9d0c-fdd5e43f6f7d req-f2d6ccb1-c75c-4b90-b39e-39e18567aec2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:52.959639 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b350773d-a81a-4823-9d0c-fdd5e43f6f7d req-f2d6ccb1-c75c-4b90-b39e-39e18567aec2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 943 time: 0.1259179 May 26 14:43:53.016037 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b350773d-a81a-4823-9d0c-fdd5e43f6f7d req-1b085da3-47bd-4b7f-8430-396f8007f4bd tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438063 May 26 14:43:53.120512 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-980a7128-36c5-42e9-8a40-8e0e37cadb79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:53.122080 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-980a7128-36c5-42e9-8a40-8e0e37cadb79 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 1096 time: 0.0785396 May 26 14:43:53.264094 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7393d08d-12c4-4a60-8192-502e2cc20db2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:53.289118 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-5344b903-30df-4b80-9386-3399171908a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:53.290714 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-5344b903-30df-4b80-9386-3399171908a4 service neutron] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 915 time: 0.1441267 May 26 14:43:53.379128 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-e569a3a8-3296-41ef-81cf-548bf6683bc8 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=c15a8128-db77-479e-9b42-25276139f049 HTTP/1.1" status: 200 len: 217 time: 0.0655663 May 26 14:43:53.453436 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-df96e37b-ea69-4721-af49-e6d537f4e4b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:53.455746 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-df96e37b-ea69-4721-af49-e6d537f4e4b2 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.0614870 May 26 14:43:53.483921 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12bc166b-f4a1-4af1-b2fc-82867fd91b5f req-1cee2ebb-9c8f-41cc-910e-6f01671a580c tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:53.485556 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-12bc166b-f4a1-4af1-b2fc-82867fd91b5f req-1cee2ebb-9c8f-41cc-910e-6f01671a580c tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 945 time: 0.0867531 May 26 14:43:53.506889 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-b5350d73-a4fd-40a8-b8fa-ecb1af31a182 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0412924 May 26 14:43:53.531078 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-12bc166b-f4a1-4af1-b2fc-82867fd91b5f req-f071a44e-398f-42d5-ab66-ac8a7e24cc8c tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397060 May 26 14:43:53.655156 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-b3f60132-9e4b-48cc-ae77-dbf7f1cf711b service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1328101 May 26 14:43:53.792826 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:53.815832 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f3d8b40c-3cad-44e9-a25a-77d592bc98ca req-9e64fb1e-b37d-4fa8-99c1-c2fcac5a6bb9 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1411862 May 26 14:43:54.072523 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-56f99a25-7967-4e4e-8c00-8fc55d800d70 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0873661 May 26 14:43:54.233577 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6272f9-7070-4797-baf9-eae88c06bc6d req-6a7d5e72-7bab-4cd0-adee-d6f79a7a1c56 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:54.235340 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fc6272f9-7070-4797-baf9-eae88c06bc6d req-6a7d5e72-7bab-4cd0-adee-d6f79a7a1c56 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1789553 May 26 14:43:54.251984 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfbafd96-3f40-48b1-9a49-13a89dc78e53 req-939b569d-b255-477f-a9cc-3c8a48cf6f69 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:54.254762 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cfbafd96-3f40-48b1-9a49-13a89dc78e53 req-939b569d-b255-477f-a9cc-3c8a48cf6f69 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 943 time: 0.1194708 May 26 14:43:54.312486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-06e83280-ede0-4598-b449-a602c0e99246 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:54.313971 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-06e83280-ede0-4598-b449-a602c0e99246 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 1098 time: 0.1064250 May 26 14:43:54.335041 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cfbafd96-3f40-48b1-9a49-13a89dc78e53 req-5557456f-45cc-4421-94fe-b0664101664b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557411 May 26 14:43:54.374218 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fc6272f9-7070-4797-baf9-eae88c06bc6d req-7c9e69b5-b82f-44b4-91ac-65d308b87449 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182914 May 26 14:43:54.434821 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39766) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:54.537051 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-51575f80-8072-435b-9d66-c22eed3242cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:54.538690 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-51575f80-8072-435b-9d66-c22eed3242cb service neutron] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 915 time: 0.1974747 May 26 14:43:54.553258 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:54.605057 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:54.619481 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:54.623368 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Usage tracker for resource:security_group_rule and tenant:f37c9aa9189a4042bd32e11fa1673c4b is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:54.626325 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:54.632115 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:54.716509 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:54.722027 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:54.728872 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-45519f5f-91ae-447d-9347-84276a9f96ab service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:54.768136 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f37c9aa9189a4042bd32e11fa1673c4b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3321512 May 26 14:43:54.770031 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4b34dba-700d-482f-b888-c323b3ac82d5,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:54.771226 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39776) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:54.773833 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:54.832175 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-cf07f3b5-e311-4236-9547-0ad41806c906 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:54.858849 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-cf07f3b5-e311-4236-9547-0ad41806c906 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:54.914362 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-cf07f3b5-e311-4236-9547-0ad41806c906 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:54.918442 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-246eec5e-a737-4201-9055-4800d4536f44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:54.929053 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf07f3b5-e311-4236-9547-0ad41806c906 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4b34dba-700d-482f-b888-c323b3ac82d5,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:54.931710 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-cf07f3b5-e311-4236-9547-0ad41806c906 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:54.938703 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-cf07f3b5-e311-4236-9547-0ad41806c906 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:54.939821 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-cf07f3b5-e311-4236-9547-0ad41806c906 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b4b34dba-700d-482f-b888-c323b3ac82d5 HTTP/1.1" status: 204 len: 168 time: 0.1673524 May 26 14:43:55.235539 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39786) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:55.253300 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:55.267757 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:43:55.271983 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Usage tracker for resource:security_group_rule and tenant:b09f4267c5d747679090f236b7e4dc5c is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:43:55.275027 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:43:55.281112 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:43:55.442267 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:55.448470 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:55.455340 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c63f85b6-2c5b-43ef-85c1-ab7fd38642c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:55.495251 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=b09f4267c5d747679090f236b7e4dc5c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2586594 May 26 14:43:55.496112 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cba25881-d385-4ab3-8dfa-a21ac6ea86c7,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:55.498120 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39794) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:43:55.499079 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:55.565034 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b63b93b-e4f3-43ef-9d62-8717dedbd610 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:55.597763 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b63b93b-e4f3-43ef-9d62-8717dedbd610 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:55.655452 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b63b93b-e4f3-43ef-9d62-8717dedbd610 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:55.659160 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:55.671115 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b63b93b-e4f3-43ef-9d62-8717dedbd610 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cba25881-d385-4ab3-8dfa-a21ac6ea86c7,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:55.673653 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9b63b93b-e4f3-43ef-9d62-8717dedbd610 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:55.681555 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b63b93b-e4f3-43ef-9d62-8717dedbd610 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:55.685027 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9b63b93b-e4f3-43ef-9d62-8717dedbd610 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/cba25881-d385-4ab3-8dfa-a21ac6ea86c7 HTTP/1.1" status: 204 len: 168 time: 0.1835928 May 26 14:43:55.884293 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:57.451941 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:57.584350 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device c15a8128-db77-479e-9b42-25276139f049 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:43:57.691902 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-4ebcfc9f-4d93-4d53-b73c-6c448dc48eea service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ec4ee3ea-9d36-4c14-a225-a3445629295c HTTP/1.1" status: 200 len: 217 time: 0.0723436 May 26 14:43:57.745803 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port c15a8128-db77-479e-9b42-25276139f049, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=c15a8128-db77-479e-9b42-25276139f049,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:57.760662 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-57c2002e-51ef-434f-a538-48311a526f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:57.761964 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-57c2002e-51ef-434f-a538-48311a526f3b service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.0635774 May 26 14:43:57.763087 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': 'c15a8128-db77-479e-9b42-25276139f049', 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'port_id': 'c15a8128-db77-479e-9b42-25276139f049', 'mac_address': 'fa:16:3e:99:32:8e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e482f08e-dc41-4d58-b9cf-6de9798b0585', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:43:57.811589 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-aca6cac4-499c-4fee-b7ea-5c7988483751 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0422397 May 26 14:43:57.830209 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:57.848882 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c15a8128-db77-479e-9b42-25276139f049 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:43:57.865097 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port c15a8128-db77-479e-9b42-25276139f049, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=c15a8128-db77-479e-9b42-25276139f049,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:43:57.871693 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:43:57.873701 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:43:57.941946 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=c15a8128-db77-479e-9b42-25276139f049,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:43:57.945071 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:43:57.949932 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d53ed25-6895-4fc2-ade7-6ff9891bf037 req-e56d7b3a-a7d0-4c82-905b-e2fa9798d321 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:57.951467 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7d53ed25-6895-4fc2-ade7-6ff9891bf037 req-e56d7b3a-a7d0-4c82-905b-e2fa9798d321 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 943 time: 0.1529665 May 26 14:43:57.960164 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-5fe30dc0-f6aa-4898-a1de-b81655eabd57 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1409218 May 26 14:43:57.967228 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d55773-70f6-466f-b368-4ea847924692 req-1a9d93e9-9299-4cda-8c69-56acb4f984f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:57.968628 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13d55773-70f6-466f-b368-4ea847924692 req-1a9d93e9-9299-4cda-8c69-56acb4f984f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1238701 May 26 14:43:58.040968 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7d53ed25-6895-4fc2-ade7-6ff9891bf037 req-1597af9a-ba58-4d73-a278-a0546d747004 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0818419 May 26 14:43:58.046401 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13d55773-70f6-466f-b368-4ea847924692 req-11bd7f03-160c-40e7-a5fb-3267db74e3ef tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646122 May 26 14:43:58.102425 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-dc786b29-4b1e-47fb-9247-f663d2987c47 req-529b1b44-e6a2-4e00-86b4-86b7f9f568c0 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1338305 May 26 14:43:58.432257 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['c15a8128-db77-479e-9b42-25276139f049'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:43:59.316802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-734ec483-c32b-4a6c-b1a7-c40187c40764 req-37d36734-4a83-4886-bfa0-4d8a72e339a2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:59.324117 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-734ec483-c32b-4a6c-b1a7-c40187c40764 req-37d36734-4a83-4886-bfa0-4d8a72e339a2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 944 time: 0.1508713 May 26 14:43:59.339443 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95060d9d-1e7f-40a1-9636-a75555050ee2 req-0a3d2e8b-ccca-4128-97cd-8bfc5498c4a7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:59.341108 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-95060d9d-1e7f-40a1-9636-a75555050ee2 req-0a3d2e8b-ccca-4128-97cd-8bfc5498c4a7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1287947 May 26 14:43:59.416345 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-734ec483-c32b-4a6c-b1a7-c40187c40764 req-a519051f-9aea-4037-9d91-026a28ed7158 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860333 May 26 14:43:59.420870 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-95060d9d-1e7f-40a1-9636-a75555050ee2 req-9fc27b81-ee9f-40bd-b2ad-01a12abfbf71 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644927 May 26 14:43:59.599355 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a812b55-987d-400a-8c76-68db466bccfe req-d8eaf6e9-9026-43e5-b436-6ce143ed2211 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:43:59.601162 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8a812b55-987d-400a-8c76-68db466bccfe req-d8eaf6e9-9026-43e5-b436-6ce143ed2211 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 945 time: 0.0855188 May 26 14:43:59.653880 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8a812b55-987d-400a-8c76-68db466bccfe req-48bd05e5-fad4-4b24-a112-deb2fa9e6338 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466516 May 26 14:44:00.613293 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672b7fd3-ac4c-4861-8cfe-3bd3c73cba52 req-142b0730-8d02-49c2-b0d4-92e9bae8a4f7 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:00.614801 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-672b7fd3-ac4c-4861-8cfe-3bd3c73cba52 req-142b0730-8d02-49c2-b0d4-92e9bae8a4f7 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 944 time: 0.0855787 May 26 14:44:00.667167 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-672b7fd3-ac4c-4861-8cfe-3bd3c73cba52 req-264a1352-9cf6-42a9-9fda-07a47c7637c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460670 May 26 14:44:00.737029 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39904) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:00.845196 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8238ddf-bba8-4be3-8627-3161439a4969 req-df8d9e2b-5e84-4849-941b-34b8bad447ac tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:00.846690 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d8238ddf-bba8-4be3-8627-3161439a4969 req-df8d9e2b-5e84-4849-941b-34b8bad447ac tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0831842 May 26 14:44:00.860474 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:00.875201 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:00.879192 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Usage tracker for resource:security_group_rule and tenant:87109f7787d4401bbfb1310225396e1f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:00.882460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:00.888443 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:00.891425 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d8238ddf-bba8-4be3-8627-3161439a4969 req-7111cd73-1317-4b87-913a-10bf2705491c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389445 May 26 14:44:00.971493 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:00.976822 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:00.983928 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:01.024711 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=87109f7787d4401bbfb1310225396e1f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2864838 May 26 14:44:01.025604 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d595a1db-deda-4d40-ae55-660cf1debb03,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:01.028271 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39910) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:01.030739 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:01.082688 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782690ed-3120-48d1-8828-06f3887717d7 req-1051c549-2678-4a62-9508-6135dffa1f7d tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:01.084175 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-782690ed-3120-48d1-8828-06f3887717d7 req-1051c549-2678-4a62-9508-6135dffa1f7d tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 945 time: 0.0933585 May 26 14:44:01.088918 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5263b2f2-ba79-4833-8a4a-ae179d6ab913 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.116074 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5263b2f2-ba79-4833-8a4a-ae179d6ab913 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.128599 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-782690ed-3120-48d1-8828-06f3887717d7 req-60b42850-050f-4a87-bb76-024b7d06751a tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383716 May 26 14:44:01.171431 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5263b2f2-ba79-4833-8a4a-ae179d6ab913 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.175745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0d3be51e-93bb-47aa-81bb-484672b0dfcd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:01.188101 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5263b2f2-ba79-4833-8a4a-ae179d6ab913 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d595a1db-deda-4d40-ae55-660cf1debb03,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:01.190492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5263b2f2-ba79-4833-8a4a-ae179d6ab913 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:01.199635 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5263b2f2-ba79-4833-8a4a-ae179d6ab913 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.203130 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5263b2f2-ba79-4833-8a4a-ae179d6ab913 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/d595a1db-deda-4d40-ae55-660cf1debb03 HTTP/1.1" status: 204 len: 168 time: 0.1719017 May 26 14:44:01.511611 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 39922) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:01.529840 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.544371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:01.549372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Usage tracker for resource:security_group_rule and tenant:d6f8bf3c9c4548c39ebb6654867a5083 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:01.554150 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:01.563376 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:01.651024 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.657159 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.664015 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-182c6924-22c0-4591-a5f9-65c60f74041a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:01.707633 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d6f8bf3c9c4548c39ebb6654867a5083&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1948915 May 26 14:44:01.708478 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10f8167e-101a-4fb6-9ba0-2408d1ea78c0,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:01.711195 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39930) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:01.711464 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:01.768370 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5895d47f-f111-4b7e-a0ef-92451a88b38a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.793913 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5895d47f-f111-4b7e-a0ef-92451a88b38a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.847779 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5895d47f-f111-4b7e-a0ef-92451a88b38a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.851579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:01.868202 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5895d47f-f111-4b7e-a0ef-92451a88b38a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10f8167e-101a-4fb6-9ba0-2408d1ea78c0,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:01.871876 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5895d47f-f111-4b7e-a0ef-92451a88b38a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:01.875376 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5895d47f-f111-4b7e-a0ef-92451a88b38a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:01.876501 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5895d47f-f111-4b7e-a0ef-92451a88b38a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/10f8167e-101a-4fb6-9ba0-2408d1ea78c0 HTTP/1.1" status: 204 len: 168 time: 0.1643379 May 26 14:44:01.945399 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device c15a8128-db77-479e-9b42-25276139f049 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:02.018063 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port c15a8128-db77-479e-9b42-25276139f049 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:02.022910 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port c15a8128-db77-479e-9b42-25276139f049 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:02.023284 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:02.150339 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:02.178134 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45acbebb-b7dd-48a6-89ee-c5e0b057813f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c15a8128-db77-479e-9b42-25276139f049'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:44:02.187674 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port c15a8128-db77-479e-9b42-25276139f049, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=c15a8128-db77-479e-9b42-25276139f049,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:02.192445 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:02.194367 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:02.264198 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=c15a8128-db77-479e-9b42-25276139f049,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:02.267449 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:03.425838 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39984) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:03.449457 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aef5c9f-8c0d-4a75-8be6-ddcc47addfb4 req-7ff5bd2c-1b99-426c-966b-2f52ddf6b2d4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:03.450966 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5aef5c9f-8c0d-4a75-8be6-ddcc47addfb4 req-7ff5bd2c-1b99-426c-966b-2f52ddf6b2d4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 945 time: 0.1448565 May 26 14:44:03.556772 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:03.556999 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51674acf-afe2-42a8-b35d-d700b2a43f0d req-2bb497b7-5b83-4d29-afa2-6805ac454f1b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:03.558279 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-51674acf-afe2-42a8-b35d-d700b2a43f0d req-2bb497b7-5b83-4d29-afa2-6805ac454f1b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1935136 May 26 14:44:03.572302 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:03.576218 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Usage tracker for resource:security_group_rule and tenant:1c68b638ad464c2cb0feb944c7278484 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:03.579044 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:03.585168 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:03.601709 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5aef5c9f-8c0d-4a75-8be6-ddcc47addfb4 req-72f30659-9a26-4cbf-8050-83c56a641306 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1440380 May 26 14:44:03.629302 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-51674acf-afe2-42a8-b35d-d700b2a43f0d req-fe82ec27-b269-4bdc-8a14-b6d435d13dea tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636566 May 26 14:44:03.692839 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45acbebb-b7dd-48a6-89ee-c5e0b057813f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c15a8128-db77-479e-9b42-25276139f049', 'code': 200} May 26 14:44:03.697805 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:03.701886 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:03.709709 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-20a12097-639e-4648-8dd8-32c5eb6fa5dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:03.754848 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=1c68b638ad464c2cb0feb944c7278484&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3273079 May 26 14:44:03.755468 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 39992) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:03.758135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b66fe9e-c15f-499f-9815-7ae47d76a734,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:03.771418 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:03.792677 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98a86381-2b81-44d5-93ea-e53f4cda782d req-a07733f2-a51f-4895-b7f4-bd778f714954 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:03.794203 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98a86381-2b81-44d5-93ea-e53f4cda782d req-a07733f2-a51f-4895-b7f4-bd778f714954 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 945 time: 0.0922012 May 26 14:44:03.831823 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-109dc825-6ad7-4d1a-9acf-552385981160 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:03.847738 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98a86381-2b81-44d5-93ea-e53f4cda782d req-c5e9371b-8265-41a3-9603-729c401ebcff tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458503 May 26 14:44:03.860261 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-109dc825-6ad7-4d1a-9acf-552385981160 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:03.917274 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-109dc825-6ad7-4d1a-9acf-552385981160 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:03.921564 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-07d5fc9f-cba1-46a7-8747-040374acc51f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:03.933455 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-109dc825-6ad7-4d1a-9acf-552385981160 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b66fe9e-c15f-499f-9815-7ae47d76a734,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:03.937337 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-109dc825-6ad7-4d1a-9acf-552385981160 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:03.940743 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-109dc825-6ad7-4d1a-9acf-552385981160 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:03.941876 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-109dc825-6ad7-4d1a-9acf-552385981160 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/4b66fe9e-c15f-499f-9815-7ae47d76a734 HTTP/1.1" status: 204 len: 168 time: 0.1852896 May 26 14:44:04.089543 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87225161-a08f-4832-8b5e-52f5af020803 req-eda11069-0da4-422c-b2b7-1f15fd2e192f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:04.091368 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-87225161-a08f-4832-8b5e-52f5af020803 req-eda11069-0da4-422c-b2b7-1f15fd2e192f service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 1098 time: 0.0892317 May 26 14:44:04.135717 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-87225161-a08f-4832-8b5e-52f5af020803 req-42b0424e-b189-47c9-8490-f53ff160ca0d service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366235 May 26 14:44:05.115376 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40046) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:05.236506 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:05.251506 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:05.255555 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Usage tracker for resource:security_group_rule and tenant:0b78b7bc041946b28804652b9119a2ca is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:05.258397 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:05.264247 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:05.366874 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:05.372441 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:05.379174 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:05.418938 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=0b78b7bc041946b28804652b9119a2ca&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3023574 May 26 14:44:05.419894 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3335d1ac-c629-4318-a7e6-86726cdd322a,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:05.421809 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40052) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:05.423041 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:05.481197 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-236f2499-cfce-4fab-9556-3fa61de9533a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:05.507171 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-236f2499-cfce-4fab-9556-3fa61de9533a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:05.560337 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-236f2499-cfce-4fab-9556-3fa61de9533a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:05.564982 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5263b2f2-ba79-4833-8a4a-ae179d6ab913 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:05.580697 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236f2499-cfce-4fab-9556-3fa61de9533a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3335d1ac-c629-4318-a7e6-86726cdd322a,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:05.583602 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-236f2499-cfce-4fab-9556-3fa61de9533a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:05.584972 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-236f2499-cfce-4fab-9556-3fa61de9533a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:05.586831 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-236f2499-cfce-4fab-9556-3fa61de9533a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/3335d1ac-c629-4318-a7e6-86726cdd322a HTTP/1.1" status: 204 len: 168 time: 0.1638062 May 26 14:44:06.314622 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40078) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:06.420401 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1314575991-network', 'tenant_id': '3defae92a9a1480c9278cae3445f9617'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:06.425286 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:06.429614 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Usage tracker for resource:network and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:06.432666 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:06.439239 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:06.451643 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Made reservation on behalf of 3defae92a9a1480c9278cae3445f9617 for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:44:06.453928 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:06.466129 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:06.480521 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:06.484666 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Usage tracker for resource:security_group_rule and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:06.487615 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:06.493808 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:06.577324 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:06.583908 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:06.588256 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:06.613364 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1108} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:44:06.626064 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11048e68-75a2-4529-93aa-c6555fbd1fe1,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:06.629500 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:06.632741 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:06.633376 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Added segment 19ef5432-879a-4038-8a6a-666cab9adc78 of type vlan for network f37261a9-5fa8-47e1-88e3-772578212058 May 26 14:44:06.665839 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:06.708186 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:06.709588 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:06.710170 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:06.713385 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:06.815901 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Pushing event updated for resources: {'Network': ['ID=f37261a9-5fa8-47e1-88e3-772578212058,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:06.820139 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:06.826075 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5103726 May 26 14:44:06.827536 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network f37261a9-5fa8-47e1-88e3-772578212058 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:44:06.829819 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40084) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:06.835603 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Request body: {'subnet': {'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1314575991-subnet', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:06.840343 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:06.844217 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Usage tracker for resource:subnet and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:06.847342 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:06.853625 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:06.865310 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Made reservation on behalf of 3defae92a9a1480c9278cae3445f9617 for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:44:06.867699 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2577413'] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.263592 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2332857', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2577427'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.267482 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-fbdf2b17-38a1-4cd9-829d-70ce93b6dafa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:07.334113 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Pushing event updated for resources: {'Subnet': ['ID=466228a3-069c-4ecc-9790-37e83a8604c9,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:07.337798 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:07.345113 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Checking segment: {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:07.345460 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Network hostable DHCP agents. Network: f37261a9-5fa8-47e1-88e3-772578212058, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:44:07.366098 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Network f37261a9-5fa8-47e1-88e3-772578212058 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:44:07.377949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, f37261a9-5fa8-47e1-88e3-772578212058) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:07.386415 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:07.386992 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.387136 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cc96f72-7d50-4bd8-9107-0fb4b0a1acb9 None None] Network f37261a9-5fa8-47e1-88e3-772578212058 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:44:07.409153 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.5782266 May 26 14:44:07.411750 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40090) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:07.417149 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:07.422018 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:07.426157 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Usage tracker for resource:router and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:07.429167 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:07.435362 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:07.447551 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.448564 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.465209 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.605758 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-f37261a9-5fa8-47e1-88e3-772578212058', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:44:07.606639 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.728866 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.759419 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Allocated IP 172.20.0.2 (f37261a9-5fa8-47e1-88e3-772578212058/466228a3-069c-4ecc-9790-37e83a8604c9/ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:07.977401 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:07.990133 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Transition to ACTIVE for port object ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:08.010779 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Transition to ACTIVE for port object ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:08.020118 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:08.025943 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:08.086130 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Network f37261a9-5fa8-47e1-88e3-772578212058 is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:08.089094 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:08.092922 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:08.125137 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Pushing event updated for resources: {'Port': ['ID=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:08.136000 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:08.210514 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Attempting to bind port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:44:08.210935 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Attempting to bind port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:44:08.211235 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Attempting to bind port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc on network f37261a9-5fa8-47e1-88e3-772578212058 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:08.216812 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:44:08.217076 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Checking segment: {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:08.217475 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:08.217863 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Bound using segment: {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:44:08.218352 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Bound port: ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:44:08.218727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:08.262840 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:08.298832 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:08.309016 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] For port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:44:08.312034 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] For port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:44:08.317426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:08.322087 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:08.373472 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8abfe61-e118-4f5b-8fab-e4044d400321 req-34232da4-b931-45b0-8ec3-cb6fae7638f1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:08.380811 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f8abfe61-e118-4f5b-8fab-e4044d400321 req-34232da4-b931-45b0-8ec3-cb6fae7638f1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 945 time: 0.2932098 May 26 14:44:08.398914 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Pushing event updated for resources: {'Port': ['ID=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:08.399128 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3b22d9-b062-4c2b-a798-8854852a306f req-d45b3844-3ddd-4dad-bfa6-4ccf341c90b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:08.406482 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ec3b22d9-b062-4c2b-a798-8854852a306f req-d45b3844-3ddd-4dad-bfa6-4ccf341c90b3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.3177392 May 26 14:44:08.412929 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:08.533804 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f8abfe61-e118-4f5b-8fab-e4044d400321 req-e075e64e-ee32-4a10-be33-3346da4a37a2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1520867 May 26 14:44:08.544363 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ec3b22d9-b062-4c2b-a798-8854852a306f req-6371ba1d-f414-4197-af28-a8efff6a997a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1369569 May 26 14:44:08.562275 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Allocated IP 172.27.3.113 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/aa37aebf-292b-4506-965f-080ccf860b05) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:08.771345 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-ef7c1ff8-e26a-4e84-ab90-2d0599fa6645 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:08.772047 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-ef7c1ff8-e26a-4e84-ab90-2d0599fa6645 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Synchronizing usage tracker for tenant:1a5c67cf2b5f455180b60afe8233d534 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:44:08.793335 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-ef7c1ff8-e26a-4e84-ab90-2d0599fa6645 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Unset dirty status for tenant:1a5c67cf2b5f455180b60afe8233d534 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:44:08.794952 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-ef7c1ff8-e26a-4e84-ab90-2d0599fa6645 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.79 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 945 time: 0.1411843 May 26 14:44:08.827145 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:08.851480 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc3ef2a-1bbf-411c-878c-06d457deb106 req-252bc306-f593-4adb-800e-48f0465cc463 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:08.853524 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5dc3ef2a-1bbf-411c-878c-06d457deb106 req-252bc306-f593-4adb-800e-48f0465cc463 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 945 time: 0.1453235 May 26 14:44:08.899634 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:08.909795 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a69f6501-024f-4b33-b198-51620e63ea7a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:08.961553 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5dc3ef2a-1bbf-411c-878c-06d457deb106 req-0962a0ef-9ebe-4b99-9d9d-3704c0dfea9f tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957191 May 26 14:44:08.993437 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Pushing event updated for resources: {'Port': ['ID=aa37aebf-292b-4506-965f-080ccf860b05,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:08.997619 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:08.998683 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:08.999524 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:09.001966 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:09.011454 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Deleting port 2e45fc02-4af4-4423-b131-3a6415bee331 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:44:09.011861 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:09.027930 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40114) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:09.210699 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:09.222223 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] For port 2e45fc02-4af4-4423-b131-3a6415bee331, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=2e45fc02-4af4-4423-b131-3a6415bee331,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:09.222602 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:09.302207 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:09.307049 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Usage tracker for resource:security_group_rule and tenant:f924f877ea19420bbd3dc2a74bca9026 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:09.311073 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:09.320177 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:09.450239 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:09.481516 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Calling delete_port for 2e45fc02-4af4-4423-b131-3a6415bee331 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:44:09.534652 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48aa8b44-e10a-435f-840c-98991ba3364d None None] Network f37261a9-5fa8-47e1-88e3-772578212058 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:44:09.627830 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:09.641840 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:09.708072 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:09.747665 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f924f877ea19420bbd3dc2a74bca9026&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7158375 May 26 14:44:09.755331 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40126) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:09.759338 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-3e697986-2dfb-4b23-8225-99638a59529e None None] Provisioning for port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:09.805437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc4b836e-1605-489e-a000-aa45a124d717,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:09.818734 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:09.847959 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:09.855012 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e21feb3a-6882-4e22-b963-c8cb06ef29b3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:09.896874 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['2e45fc02-4af4-4423-b131-3a6415bee331'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:44:09.938654 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Pushing event deleted for resources: {'Port': ['ID=2e45fc02-4af4-4423-b131-3a6415bee331,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:09.964572 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:09.971056 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:10.011553 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d51f76a4-da7f-4295-9d4f-393ef5e58830 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.037081 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] No DVR routers for this DVR port 2e45fc02-4af4-4423-b131-3a6415bee331 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:44:10.044613 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.047581 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9b85793c-a6bc-44a6-8692-4281b66fbcf3', 'name': 'network-vif-deleted', 'tag': '2e45fc02-4af4-4423-b131-3a6415bee331'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:44:10.052045 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:10.058884 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:10.059552 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.076558 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d51f76a4-da7f-4295-9d4f-393ef5e58830 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.111352 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e7a182f0-1b00-4c5d-b376-e0ad5dbca05b req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.79 "DELETE /v2.0/ports/2e45fc02-4af4-4423-b131-3a6415bee331 HTTP/1.1" status: 204 len: 173 time: 1.3072672 May 26 14:44:10.127952 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.150823 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d51f76a4-da7f-4295-9d4f-393ef5e58830 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.155004 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6a46e4dc-f8b5-4fe5-af55-3f708dbe9090 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:10.169318 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d51f76a4-da7f-4295-9d4f-393ef5e58830 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc4b836e-1605-489e-a000-aa45a124d717,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:10.172375 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d51f76a4-da7f-4295-9d4f-393ef5e58830 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:10.179028 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d51f76a4-da7f-4295-9d4f-393ef5e58830 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.183645 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-d51f76a4-da7f-4295-9d4f-393ef5e58830 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/fc4b836e-1605-489e-a000-aa45a124d717 HTTP/1.1" status: 204 len: 168 time: 0.4234688 May 26 14:44:10.242894 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.256682 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-32805812-d45a-4f37-9c72-4288b7ecd6a1 None None] Provisioning complete for port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:10.257220 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-32805812-d45a-4f37-9c72-4288b7ecd6a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.327065 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be3809e-2999-4edb-a9e7-9bb9a3510ee8 req-e902d18e-94fa-4fd5-8d31-b48662bd2ea7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:10.332742 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:10.334432 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2be3809e-2999-4edb-a9e7-9bb9a3510ee8 req-e902d18e-94fa-4fd5-8d31-b48662bd2ea7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.4424832 May 26 14:44:10.340624 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.342839 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:10.377121 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60146dc5-356d-441d-a3da-bbfa00f1e26a req-e98c2c4b-2886-45c4-aba6-f8024f3353c4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:10.379914 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-60146dc5-356d-441d-a3da-bbfa00f1e26a req-e98c2c4b-2886-45c4-aba6-f8024f3353c4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 945 time: 0.4880831 May 26 14:44:10.443677 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2be3809e-2999-4edb-a9e7-9bb9a3510ee8 req-4babb713-549b-4ea8-81a8-5880bd1e5b83 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075382 May 26 14:44:10.480656 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-60146dc5-356d-441d-a3da-bbfa00f1e26a req-cc0f10ec-c3bb-49f3-8062-7815c93cc221 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834916 May 26 14:44:10.496168 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:10.500665 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:10.504132 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Router 7cd46f66-75af-44f8-b523-9201f57ddbda is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98445) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:44:10.557025 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9b85793c-a6bc-44a6-8692-4281b66fbcf3', 'name': 'network-vif-deleted', 'tag': '2e45fc02-4af4-4423-b131-3a6415bee331', 'status': 'completed', 'code': 200} May 26 14:44:10.644146 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e1893b06-11b3-47ca-b689-1129f56fe435 req-acb1c6bd-1d51-42eb-b853-0dbb73c53d37 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=9b85793c-a6bc-44a6-8692-4281b66fbcf3 HTTP/1.1" status: 200 len: 210 time: 0.0663149 May 26 14:44:10.808079 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:44:10.819554 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Sync routers for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:44:10.838497 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:44:10.839138 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:10.861932 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:10.864708 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 3.4511273 May 26 14:44:10.866811 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40166) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:11.106086 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:44:11.487930 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:09Z', 'revision_number': 3, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:11.493154 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Checking router: 7cd46f66-75af-44f8-b523-9201f57ddbda for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:44:11.493961 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Updating router 7cd46f66-75af-44f8-b523-9201f57ddbda port aa37aebf-292b-4506-965f-080ccf860b05 binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:44:11.559244 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:11.725781 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64cce6d9-84a3-475f-bf27-712514173761 req-34cbdd4a-586b-4f8d-b614-768317d8733d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:11.729596 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-64cce6d9-84a3-475f-bf27-712514173761 req-34cbdd4a-586b-4f8d-b614-768317d8733d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1281757 May 26 14:44:11.829362 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-64cce6d9-84a3-475f-bf27-712514173761 req-74ade86f-36e4-4a9a-b41a-ff533a77215a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0925450 May 26 14:44:11.933222 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:12.033852 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.075248 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.091594 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Transition to ACTIVE for port object aa37aebf-292b-4506-965f-080ccf860b05 will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:12.107945 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.115178 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:12.116257 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:12.116690 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.211284 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Pushing event updated for resources: {'Port': ['ID=aa37aebf-292b-4506-965f-080ccf860b05,revision_number=2']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:12.227503 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.232312 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.232795 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.233277 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.234897 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.236270 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.236744 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.238006 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.238371 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.243402 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.243747 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.244069 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:12.285710 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:12.350464 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Attempting to bind port aa37aebf-292b-4506-965f-080ccf860b05 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:44:12.350822 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Attempting to bind port aa37aebf-292b-4506-965f-080ccf860b05 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:44:12.351172 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Attempting to bind port aa37aebf-292b-4506-965f-080ccf860b05 on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:12.359237 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:44:12.359605 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:12.360022 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.360401 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:44:12.360866 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Bound port: aa37aebf-292b-4506-965f-080ccf860b05, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:44:12.361384 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.373951 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Allocated IP 172.20.0.1 (f37261a9-5fa8-47e1-88e3-772578212058/466228a3-069c-4ecc-9790-37e83a8604c9/d256d0f7-b3e5-470b-9049-adf3e1632cbc) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:12.438372 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] For port aa37aebf-292b-4506-965f-080ccf860b05, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:44:12.441535 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] For port aa37aebf-292b-4506-965f-080ccf860b05, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=aa37aebf-292b-4506-965f-080ccf860b05,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:44:12.445901 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.450797 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:12.480231 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-b9bdc484-5d38-4270-9a5a-084cd28549c5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:12.487990 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-b9bdc484-5d38-4270-9a5a-084cd28549c5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/networks?id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837 HTTP/1.1" status: 200 len: 809 time: 0.1902764 May 26 14:44:12.498780 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-2c3a4c81-31f9-465d-bbf7-c88265b0d446 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/quotas/1a5c67cf2b5f455180b60afe8233d534 HTTP/1.1" status: 200 len: 375 time: 0.0098279 May 26 14:44:12.527984 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:44:12.528631 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:12.549573 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-b3dcdddc-4c79-4724-b50e-3ae9871a1459 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=1a5c67cf2b5f455180b60afe8233d534&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0439258 May 26 14:44:12.624215 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.625738 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Pushing event updated for resources: {'Port': ['ID=aa37aebf-292b-4506-965f-080ccf860b05,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:12.646518 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-60adede3-49a4-471a-9510-ba5eaf78c907 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:12.652161 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Transition to ACTIVE for port object d256d0f7-b3e5-470b-9049-adf3e1632cbc will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:12.689804 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.695534 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2e316a8b-e83a-4ce2-be25-6d4c1a518982 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:12.714681 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-13169adc-541d-4831-a34a-c7f8a52a7e3b service neutron] 10.222.0.72 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1576917 May 26 14:44:12.760319 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:44:12.765544 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Network f37261a9-5fa8-47e1-88e3-772578212058 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:12.769037 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:12.773223 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:12.822854 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Pushing event updated for resources: {'Port': ['ID=d256d0f7-b3e5-470b-9049-adf3e1632cbc,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:12.827281 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:12.846261 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:12.945279 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-e76cf8b5-b706-45b0-adb2-3c2bea8149c2 service neutron] 10.222.0.72 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2292442 May 26 14:44:13.127102 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 2e45fc02-4af4-4423-b131-3a6415bee331 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:44:13.202504 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:13.224697 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 2e45fc02-4af4-4423-b131-3a6415bee331 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:44:13.227497 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 2e45fc02-4af4-4423-b131-3a6415bee331 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:44:13.254496 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-6a7ea54b-4e81-44f1-9325-4adb6fc39310 None None] Provisioning for port d256d0f7-b3e5-470b-9049-adf3e1632cbc completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:13.259625 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-6a7ea54b-4e81-44f1-9325-4adb6fc39310 None None] Provisioning complete for port d256d0f7-b3e5-470b-9049-adf3e1632cbc triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:13.260448 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-6a7ea54b-4e81-44f1-9325-4adb6fc39310 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:13.273866 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:44:13.368731 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-baf0ad2d-dbd8-4cdd-9b11-0f339bbecf3c req-ad4aa16d-3ba7-4c70-abab-4a9682f92d90 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 210 time: 0.0682526 May 26 14:44:13.378817 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-6a7ea54b-4e81-44f1-9325-4adb6fc39310 None None] Port d256d0f7-b3e5-470b-9049-adf3e1632cbc cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:44:13.434634 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:09Z', 'revision_number': 3, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:13.446792 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b7eec01-09c3-4326-9d0f-5bc5a68b07e2 None None] The sync data for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi is: [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:09Z', 'revision_number': 3, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:44:13.457439 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27f65073-af41-419c-84ca-5ac1363fc4d7 req-7f947b0d-3cde-4325-886d-320bcdf2bd66 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:13.462939 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-27f65073-af41-419c-84ca-5ac1363fc4d7 req-7f947b0d-3cde-4325-886d-320bcdf2bd66 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.3807933 May 26 14:44:13.534901 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-27f65073-af41-419c-84ca-5ac1363fc4d7 req-ddbd7c5f-45e2-4beb-9bf9-dbd45ba700f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663848 May 26 14:44:13.583945 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:13.590514 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:13.626083 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ea7723a3-7e7f-4166-a509-ac6461d42b64 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:13.715483 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:13.719395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Pushing event updated for resources: {'Port': ['ID=d256d0f7-b3e5-470b-9049-adf3e1632cbc,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:13.723260 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:13.931800 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Network f37261a9-5fa8-47e1-88e3-772578212058 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:13.933330 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:13.995366 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device aa37aebf-292b-4506-965f-080ccf860b05 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:14.163378 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port aa37aebf-292b-4506-965f-080ccf860b05 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:14.169625 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port aa37aebf-292b-4506-965f-080ccf860b05 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:14.170001 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:14.275896 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Router 7cd46f66-75af-44f8-b523-9201f57ddbda has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:44:14.407449 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-cf29a42a-1931-41dd-81e8-ad51388c95e0 None None] Provisioning complete for port d256d0f7-b3e5-470b-9049-adf3e1632cbc triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:14.407835 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-cf29a42a-1931-41dd-81e8-ad51388c95e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:14.532758 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:14.537878 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-cf29a42a-1931-41dd-81e8-ad51388c95e0 None None] Port d256d0f7-b3e5-470b-9049-adf3e1632cbc cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:44:14.555940 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port aa37aebf-292b-4506-965f-080ccf860b05, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=aa37aebf-292b-4506-965f-080ccf860b05,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:14.563261 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:14.565326 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:14.590063 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:44:14.604649 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] 10.222.0.72 "PUT /v2.0/routers/7cd46f66-75af-44f8-b523-9201f57ddbda/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7364759 May 26 14:44:14.637310 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=aa37aebf-292b-4506-965f-080ccf860b05,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:14.639246 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4f10a0a-81f5-48d9-87e9-1f6bf7bdc26e req-ee3ca5c4-58d9-4165-bfa3-e2cb5d11211b tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 210 time: 0.0969903 May 26 14:44:14.641189 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:14.898569 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-37063dd7-c8f6-4ce0-9134-3b1d9e684deb tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:14.900054 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-37063dd7-c8f6-4ce0-9134-3b1d9e684deb tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 813 time: 0.2063189 May 26 14:44:14.923326 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc53c4c-31f6-4dc3-b5d0-189e0e421c3c req-0617a3a6-b9fb-4228-9788-0df4f28a7b8f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:14.924746 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5bc53c4c-31f6-4dc3-b5d0-189e0e421c3c req-0617a3a6-b9fb-4228-9788-0df4f28a7b8f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1488886 May 26 14:44:14.926884 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-2dd942d1-0a29-4607-a0c2-60fc9131e2c3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/quotas/3159eb22d2eb468e967fa04761ae0331 HTTP/1.1" status: 200 len: 375 time: 0.0206034 May 26 14:44:15.022779 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5bc53c4c-31f6-4dc3-b5d0-189e0e421c3c req-63d2385e-b9fa-44f7-b0db-9b93b73c2dc5 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909793 May 26 14:44:15.058874 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-0cb1fed3-60c5-458a-bfb3-eed962d93073 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1257987 May 26 14:44:15.204666 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-046d7e82-8eca-47e5-9972-889462d4a6aa service neutron] 10.222.0.72 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1441829 May 26 14:44:15.260437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40292) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:15.266099 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1144548630-network', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:15.271116 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:15.275355 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Usage tracker for resource:network and tenant:91aab1b1c8f643b5a396e20256a142c6 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:15.278509 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:15.284443 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:15.298486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Made reservation on behalf of 91aab1b1c8f643b5a396e20256a142c6 for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:44:15.301566 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.315038 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.329693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:15.334060 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Usage tracker for resource:security_group_rule and tenant:91aab1b1c8f643b5a396e20256a142c6 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:15.336993 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:15.343068 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:15.347290 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-af8913b6-0ad2-4ca5-b63c-84b8ba4b3ef6 service neutron] 10.222.0.72 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1359279 May 26 14:44:15.437682 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.443163 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.446215 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-109dc825-6ad7-4d1a-9acf-552385981160 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:15.481294 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1139} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:44:15.486934 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6281e1ea-f0e2-4c67-a0ed-fb56ffaba5de,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:15.490703 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:15.494987 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.494987 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Added segment 4adb3784-0b4e-4b28-bcc1-ba118c24af86 of type vlan for network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da May 26 14:44:15.529268 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.567940 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.569339 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:15.569912 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.574752 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d3445aa6-7e66-414d-8c43-8746922b8243 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:15.624186 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Sync routers for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:44:15.633625 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.3720555 May 26 14:44:15.634902 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:44:15.635527 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:15.636458 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40306) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:15.643088 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Request body: {'subnet': {'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1144548630-subnet', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:15.648655 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:15.657449 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Usage tracker for resource:subnet and tenant:91aab1b1c8f643b5a396e20256a142c6 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:15.660866 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:15.669775 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:15.683580 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Made reservation on behalf of 91aab1b1c8f643b5a396e20256a142c6 for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:44:15.686721 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2577413'] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:15.708719 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Pushing event updated for resources: {'Network': ['ID=9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:15.712432 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:15.722295 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:44:15.915990 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device aa37aebf-292b-4506-965f-080ccf860b05 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:15.992078 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:44:16.104443 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2332857', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2577427'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.108546 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-57e91a20-3c29-442c-a184-5fd501df0519 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:16.141559 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port aa37aebf-292b-4506-965f-080ccf860b05 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:16.141784 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.183762 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Pushing event updated for resources: {'Subnet': ['ID=67eca565-c006-4f3d-aa95-7b676123e9ba,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:16.187541 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:16.194944 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Checking segment: {'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:16.195338 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Network hostable DHCP agents. Network: 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:44:16.215329 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:44:16.225090 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:16.233627 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:16.234232 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.240930 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d04a043-c2f9-4bd3-a981-8d5d00b1149f None None] Network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:44:16.257837 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6bed4d91-40df-46d9-8fb0-da5639a6c04e admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6194379 May 26 14:44:16.260499 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40318) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:16.265701 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:16.270761 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:16.275313 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Usage tracker for resource:router and tenant:91aab1b1c8f643b5a396e20256a142c6 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:16.278531 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:16.284978 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:16.296946 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.298105 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.314563 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.656514 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da', 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'fixed_ips': [{'subnet_id': '67eca565-c006-4f3d-aa95-7b676123e9ba'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:44:16.657352 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.667423 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.677775 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:13Z', 'revision_number': 2, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:16.719667 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Checking router: 7cd46f66-75af-44f8-b523-9201f57ddbda for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:44:16.720024 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Updating router 7cd46f66-75af-44f8-b523-9201f57ddbda port d256d0f7-b3e5-470b-9049-adf3e1632cbc binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:44:16.795761 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:16.958697 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Allocated IP 172.20.0.2 (9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da/67eca565-c006-4f3d-aa95-7b676123e9ba/c5e2da0e-7659-40f1-82f7-05210e4c2bca) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:16.981697 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.015546 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.217269 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Allocated IP 172.27.3.252 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/00d2d99f-c77d-4827-9e5d-5d2cf76070fd) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:17.286434 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b3c1ecc3-70a6-4c77-aaed-7e15e1e1e040 req-3e2c701c-3edb-47aa-a781-b176b631ec00 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 210 time: 0.0636261 May 26 14:44:17.310410 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.320639 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Transition to ACTIVE for port object c5e2da0e-7659-40f1-82f7-05210e4c2bca will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:17.339727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Transition to ACTIVE for port object c5e2da0e-7659-40f1-82f7-05210e4c2bca will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:17.344787 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-54ddc71d-408b-448a-8d72-b8828e94a6c7 req-81eee97b-f8b0-48df-8933-8c84b033a5ab tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 210 time: 0.0635977 May 26 14:44:17.380558 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.386670 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:17.508732 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:17.518021 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:17.522936 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Pushing event updated for resources: {'Port': ['ID=c5e2da0e-7659-40f1-82f7-05210e4c2bca,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:17.525313 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:17.539525 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.561126 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-041dd7c4-4bdb-4504-b202-55140982d9f8 req-256b45c0-2e4f-4a06-9f71-42dac188f888 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:17.562914 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-041dd7c4-4bdb-4504-b202-55140982d9f8 req-256b45c0-2e4f-4a06-9f71-42dac188f888 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1639352 May 26 14:44:17.586102 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:17.604310 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.626359 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-041dd7c4-4bdb-4504-b202-55140982d9f8 req-e853cb2e-ad90-4963-bc0f-84b56ae7adab tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547240 May 26 14:44:17.641215 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.653793 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:17.692583 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Transition to ACTIVE for port object d256d0f7-b3e5-470b-9049-adf3e1632cbc will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:17.720925 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.730644 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:17.740050 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Pushing event updated for resources: {'Port': ['ID=00d2d99f-c77d-4827-9e5d-5d2cf76070fd,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:17.743184 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:17.749846 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:17.751085 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:17.753803 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:17.783211 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Attempting to bind port c5e2da0e-7659-40f1-82f7-05210e4c2bca on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:44:17.783561 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Attempting to bind port c5e2da0e-7659-40f1-82f7-05210e4c2bca by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:44:17.783929 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Attempting to bind port c5e2da0e-7659-40f1-82f7-05210e4c2bca on network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:17.844807 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:44:17.845176 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Checking segment: {'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:17.845582 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:17.845990 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Bound using segment: {'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:44:17.846502 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Bound port: c5e2da0e-7659-40f1-82f7-05210e4c2bca, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:44:17.846882 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:18.113256 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aeef2b8-dce1-4bc1-9f24-7b48f65cd53e None None] Pushing event updated for resources: {'Port': ['ID=d256d0f7-b3e5-470b-9049-adf3e1632cbc,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:18.141604 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-1aeef2b8-dce1-4bc1-9f24-7b48f65cd53e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.411s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:18.571395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-cbce644d-a5c2-4154-92a2-4391e540cee6 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:18.572903 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-cbce644d-a5c2-4154-92a2-4391e540cee6 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.79 "GET /v2.0/networks?id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837 HTTP/1.1" status: 200 len: 809 time: 0.7110565 May 26 14:44:18.585723 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Attempting to bind port d256d0f7-b3e5-470b-9049-adf3e1632cbc on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:44:18.586430 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Attempting to bind port d256d0f7-b3e5-470b-9049-adf3e1632cbc by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:44:18.586929 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Attempting to bind port d256d0f7-b3e5-470b-9049-adf3e1632cbc on network f37261a9-5fa8-47e1-88e3-772578212058 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:18.600198 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:44:18.600766 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Checking segment: {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:18.601441 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:18.602240 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Bound using segment: {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:44:18.602993 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Bound port: d256d0f7-b3e5-470b-9049-adf3e1632cbc, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:44:18.603537 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:18.683442 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Request body: {'port': {'device_id': '863c827c-cd8f-4809-9bdf-ab60f8fb191a', 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837', 'admin_state_up': True, 'tenant_id': '1a5c67cf2b5f455180b60afe8233d534'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:18.710929 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] For port c5e2da0e-7659-40f1-82f7-05210e4c2bca, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:44:18.736751 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] For port c5e2da0e-7659-40f1-82f7-05210e4c2bca, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=c5e2da0e-7659-40f1-82f7-05210e4c2bca,segment=NetworkSegment(4adb3784-0b4e-4b28-bcc1-ba118c24af86),segment_id=4adb3784-0b4e-4b28-bcc1-ba118c24af86)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:44:18.769965 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:18.816666 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:18.830971 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:18.875592 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:18.880730 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Usage tracker for resource:port and tenant:1a5c67cf2b5f455180b60afe8233d534 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:18.884018 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:18.890114 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:18.901463 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Made reservation on behalf of 1a5c67cf2b5f455180b60afe8233d534 for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:44:18.905881 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:18.958650 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9078373e-d63e-478e-b40c-4bef45a5738c req-356dcd37-81f9-49c2-9096-f927652c18b2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 210 time: 0.2818887 May 26 14:44:18.984905 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] For port d256d0f7-b3e5-470b-9049-adf3e1632cbc, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:44:18.986508 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Pushing event updated for resources: {'Port': ['ID=c5e2da0e-7659-40f1-82f7-05210e4c2bca,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:18.990593 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:18.992926 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] For port d256d0f7-b3e5-470b-9049-adf3e1632cbc, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d256d0f7-b3e5-470b-9049-adf3e1632cbc,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:44:19.013326 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:19.017465 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:19.140540 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Allocated IP 172.20.0.11 (ed7a1e1a-7ae1-41d4-a402-addaf23d4837/12c3a6cc-90f7-4a24-9389-58ed3aa06051/6dd3d162-1705-4ed8-b8bc-cd16968be071) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:19.142842 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-55989580-6ee2-47e6-9801-4b890ae3ffce req-8bfa4959-20bc-445f-9890-671c5feb2703 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 210 time: 0.4535716 May 26 14:44:19.152659 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aeef2b8-dce1-4bc1-9f24-7b48f65cd53e None None] Pushing event updated for resources: {'Port': ['ID=d256d0f7-b3e5-470b-9049-adf3e1632cbc,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:19.166000 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-1aeef2b8-dce1-4bc1-9f24-7b48f65cd53e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:19.166675 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:44:19.166898 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:19.418008 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:44:19.459219 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:19.504284 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:19.526936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9a4f7305-04f1-4d1f-a303-c7d3621902ca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:19.582885 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-8eee2d00-436a-44f8-bb88-b0aefb60045b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:19.584541 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-8eee2d00-436a-44f8-bb88-b0aefb60045b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 813 time: 0.8437548 May 26 14:44:19.623324 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Pushing event updated for resources: {'Port': ['ID=6dd3d162-1705-4ed8-b8bc-cd16968be071,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:19.628332 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:19.635205 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:19.636494 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:19.639103 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:19.665102 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Request body: {'port': {'device_id': '932955a5-6814-4e65-b44e-7e16f6c372fe', 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'admin_state_up': True, 'tenant_id': '3159eb22d2eb468e967fa04761ae0331'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:19.715982 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d386c6-0ead-4f6a-94cc-85504a185b55 req-4f862b24-4284-4701-9b8a-23c3f061112a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:19.718972 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a3d386c6-0ead-4f6a-94cc-85504a185b55 req-4f862b24-4284-4701-9b8a-23c3f061112a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.5701039 May 26 14:44:19.773881 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:19.775564 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:19.809824 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1307530 May 26 14:44:19.839025 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Request body: {'port': {'device_id': '863c827c-cd8f-4809-9bdf-ab60f8fb191a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:19.869114 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:18Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:19.870916 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a3d386c6-0ead-4f6a-94cc-85504a185b55 req-de63c1ac-77ce-410d-8f1a-089737a68f6b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1510971 May 26 14:44:19.873490 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-babe6dee-321a-4124-a9bd-1a119a66638e None None] The sync data for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi is: [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:18Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:44:19.894406 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:20.051448 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device c5e2da0e-7659-40f1-82f7-05210e4c2bca up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:20.198877 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:20.237544 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port c5e2da0e-7659-40f1-82f7-05210e4c2bca completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:20.358426 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:20.380845 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3475ea59-f74e-4c93-9436-0a2233af4645 req-902499e8-a47a-4629-a628-0a2c2575daf1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 210 time: 0.1124811 May 26 14:44:20.388456 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Usage tracker for resource:port and tenant:3159eb22d2eb468e967fa04761ae0331 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:20.401455 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:20.415981 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:20.454098 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Made reservation on behalf of 3159eb22d2eb468e967fa04761ae0331 for: {'port': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:44:20.459392 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:20.577400 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24945417-6cbf-4f37-8ecb-0e93a6b3ecf4 None None] Network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:44:20.636642 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Router 062edae0-d41c-480c-8f65-df561aba5774 is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98445) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:44:20.763508 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6dd3d162-1705-4ed8-b8bc-cd16968be071 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:44:20.776368 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:20.796182 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Transition to ACTIVE for port object 6dd3d162-1705-4ed8-b8bc-cd16968be071 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:20.803606 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:20.813506 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c4f3f90d-67c0-4350-a791-54462dc93a50 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:20.817099 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] Provisioning for port c5e2da0e-7659-40f1-82f7-05210e4c2bca completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:20.839157 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] Provisioning complete for port c5e2da0e-7659-40f1-82f7-05210e4c2bca triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:20.839538 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:20.980574 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Pushing event updated for resources: {'Port': ['ID=6dd3d162-1705-4ed8-b8bc-cd16968be071,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:20.985229 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:21.106341 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.173725 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Attempting to bind port 6dd3d162-1705-4ed8-b8bc-cd16968be071 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:44:21.174533 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Attempting to bind port 6dd3d162-1705-4ed8-b8bc-cd16968be071 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:44:21.175299 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Attempting to bind port 6dd3d162-1705-4ed8-b8bc-cd16968be071 on network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:21.175416 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-023b6afa-7c7a-4495-8936-8c7d6d67438f req-446e0188-d292-4ca2-8da0-ebe73a57cd28 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:21.183212 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] For port c5e2da0e-7659-40f1-82f7-05210e4c2bca, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=c5e2da0e-7659-40f1-82f7-05210e4c2bca,segment=NetworkSegment(4adb3784-0b4e-4b28-bcc1-ba118c24af86),segment_id=4adb3784-0b4e-4b28-bcc1-ba118c24af86)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:21.183776 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Port 6dd3d162-1705-4ed8-b8bc-cd16968be071 on network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:44:21.184316 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Attempting to bind port 6dd3d162-1705-4ed8-b8bc-cd16968be071 on network ed7a1e1a-7ae1-41d4-a402-addaf23d4837 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:21.187325 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-023b6afa-7c7a-4495-8936-8c7d6d67438f req-446e0188-d292-4ca2-8da0-ebe73a57cd28 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 932 time: 0.6641471 May 26 14:44:21.193548 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.196076 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-9b2845af-2478-4c4e-a33c-fbfe9bf9686f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:21.202249 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:44:21.204788 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Checking segment: {'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:21.209609 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Bound using segment: {'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:44:21.210290 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Bound port: 6dd3d162-1705-4ed8-b8bc-cd16968be071, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd3f9151f-5909-4b72-bd16-08d37a5eb84a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1115, 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:44:21.210959 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.259371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Allocated IP 172.20.0.11 (c6d63b53-7bae-4cfb-ac0b-4643c0894395/e482f08e-dc41-4d58-b9cf-6de9798b0585/6edfff02-2e00-4da7-8c08-37a887f1f08f) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:21.325754 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] Pushing event updated for resources: {'Port': ['ID=c5e2da0e-7659-40f1-82f7-05210e4c2bca,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:21.329309 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:21.333984 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] For port 6dd3d162-1705-4ed8-b8bc-cd16968be071, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:44:21.337672 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] For port 6dd3d162-1705-4ed8-b8bc-cd16968be071, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6dd3d162-1705-4ed8-b8bc-cd16968be071,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:44:21.346634 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.351447 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:21.419293 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-d762bba4-5b7e-4f4f-bc15-254b94f89a12 None None] Provisioning complete for port c5e2da0e-7659-40f1-82f7-05210e4c2bca triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:21.419682 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d762bba4-5b7e-4f4f-bc15-254b94f89a12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.435169 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:21.436152 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.437882 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] 10.222.0.79 "PUT /v2.0/ports/6dd3d162-1705-4ed8-b8bc-cd16968be071 HTTP/1.1" status: 200 len: 1094 time: 1.6052244 May 26 14:44:21.438595 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '863c827c-cd8f-4809-9bdf-ab60f8fb191a', 'tag': '6dd3d162-1705-4ed8-b8bc-cd16968be071'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:44:21.460064 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Pushing event updated for resources: {'Port': ['ID=6dd3d162-1705-4ed8-b8bc-cd16968be071,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:21.464611 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:21.590929 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:44:21.606218 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Sync routers for ids ['062edae0-d41c-480c-8f65-df561aba5774'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:44:21.628321 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Routers {'062edae0-d41c-480c-8f65-df561aba5774'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:44:21.631907 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:43:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['062edae0-d41c-480c-8f65-df561aba5774'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:21.647530 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f0d98180-2719-4ef6-b3de-66ac48bf3d1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.668274 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-023b6afa-7c7a-4495-8936-8c7d6d67438f req-eae4270c-69e4-493b-8483-6422ac8e9e5e tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4789383 May 26 14:44:21.683918 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a6f5c5e2-fb4c-4137-8160-3022338469e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:21.686561 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-a6f5c5e2-fb4c-4137-8160-3022338469e7 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=1a5c67cf2b5f455180b60afe8233d534&device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 1097 time: 0.1540818 May 26 14:44:21.728466 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.732852 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 5.4713204 May 26 14:44:21.737414 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40420) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:21.864605 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a69dac6-2776-4367-856b-ce723263cbc9 req-5efb1095-336d-483a-8b34-300294b8cdb9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:21.869189 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Set router 062edae0-d41c-480c-8f65-df561aba5774 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:44:21.873076 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8a69dac6-2776-4367-856b-ce723263cbc9 req-5efb1095-336d-483a-8b34-300294b8cdb9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.5190659 May 26 14:44:21.895783 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:21.901911 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-1c14cc4e-acdc-4f7d-a6a8-c225b4b30762 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6dd3d162-1705-4ed8-b8bc-cd16968be071 HTTP/1.1" status: 200 len: 217 time: 0.1869910 May 26 14:44:22.031892 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8a69dac6-2776-4367-856b-ce723263cbc9 req-86453345-43b5-4765-ae6a-bcea24ecff78 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1576326 May 26 14:44:22.032684 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d256d0f7-b3e5-470b-9049-adf3e1632cbc up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:22.073243 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-d9b64f30-c17c-43f6-ae7f-0d50e6b4788b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:22.076521 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-d9b64f30-c17c-43f6-ae7f-0d50e6b4788b service neutron] 10.222.0.79 "GET /v2.0/subnets?id=12c3a6cc-90f7-4a24-9389-58ed3aa06051 HTTP/1.1" status: 200 len: 849 time: 0.1140766 May 26 14:44:22.178271 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-bceb316c-2a2f-460d-9795-c893fd9bba67 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0928423 May 26 14:44:22.184248 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port d256d0f7-b3e5-470b-9049-adf3e1632cbc completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:22.191923 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d256d0f7-b3e5-470b-9049-adf3e1632cbc triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:22.192863 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.213922 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '863c827c-cd8f-4809-9bdf-ab60f8fb191a', 'tag': '6dd3d162-1705-4ed8-b8bc-cd16968be071', 'status': 'completed', 'code': 200} May 26 14:44:22.237870 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.278012 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:22.317091 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ec4ee3ea-9d36-4c14-a225-a3445629295c', 'c15a8128-db77-479e-9b42-25276139f049'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:44:22.332058 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252'}], 'enable_snat': True}, 'gw_port_id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:44:18Z', 'revision_number': 3, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port': {'id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:f4:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:17Z', 'updated_at': '2021-05-26T14:44:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:22.342684 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Checking router: 062edae0-d41c-480c-8f65-df561aba5774 for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:44:22.343416 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Updating router 062edae0-d41c-480c-8f65-df561aba5774 port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:44:22.356406 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-daca398f-de91-4ea9-98ba-6edd550d1686 service neutron] 10.222.0.79 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1670468 May 26 14:44:22.372953 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Network c6d63b53-7bae-4cfb-ac0b-4643c0894395 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:22.380408 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:22.400134 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.419166 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.447604 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:22.471823 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port d256d0f7-b3e5-470b-9049-adf3e1632cbc, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d256d0f7-b3e5-470b-9049-adf3e1632cbc,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:22.486256 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.487637 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device c5e2da0e-7659-40f1-82f7-05210e4c2bca up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:22.548453 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6287e98f-30c5-4bd1-966f-924cdf9d408e req-920d6cf5-4e3d-4ad5-b92f-ce583ad7a244 service neutron] 10.222.0.79 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1620247 May 26 14:44:22.555777 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:22.595565 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:22.596971 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.625802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Pushing event updated for resources: {'Port': ['ID=6edfff02-2e00-4da7-8c08-37a887f1f08f,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:22.630913 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.354s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:22.640794 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75348992-5e70-4346-a6ea-ec5843f69a98 req-be49ca90-2345-4ec7-9f58-c4365e3f3030 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:22.641547 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-75348992-5e70-4346-a6ea-ec5843f69a98 req-be49ca90-2345-4ec7-9f58-c4365e3f3030 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Synchronizing usage tracker for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:44:22.685160 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.0359194 May 26 14:44:22.689633 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-75348992-5e70-4346-a6ea-ec5843f69a98 req-be49ca90-2345-4ec7-9f58-c4365e3f3030 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Unset dirty status for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:44:22.699174 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-75348992-5e70-4346-a6ea-ec5843f69a98 req-be49ca90-2345-4ec7-9f58-c4365e3f3030 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 932 time: 0.4994378 May 26 14:44:22.707624 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port c5e2da0e-7659-40f1-82f7-05210e4c2bca triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:22.707997 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.775622 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=d256d0f7-b3e5-470b-9049-adf3e1632cbc,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:22.787812 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:22.861264 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-ab0f6411-57d1-4f14-8eb7-97916d9c405e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:22.867257 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-ab0f6411-57d1-4f14-8eb7-97916d9c405e service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=1a5c67cf2b5f455180b60afe8233d534&device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 1097 time: 0.1827803 May 26 14:44:22.912433 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.925401 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Transition to ACTIVE for port object 00d2d99f-c77d-4827-9e5d-5d2cf76070fd will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:22.931860 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Request body: {'port': {'device_id': '932955a5-6814-4e65-b44e-7e16f6c372fe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:22.933489 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:22.938700 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:23.050899 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-4ea2945f-3f85-4e72-81ad-afea06d66d0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:23.052472 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-4ea2945f-3f85-4e72-81ad-afea06d66d0e service neutron] 10.222.0.79 "GET /v2.0/networks?id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837 HTTP/1.1" status: 200 len: 911 time: 0.1750352 May 26 14:44:23.062877 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f0cee12-f044-4d8c-b26a-70b321cb7312 None None] Pushing event updated for resources: {'Port': ['ID=00d2d99f-c77d-4827-9e5d-5d2cf76070fd,revision_number=2']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:23.066207 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-1f0cee12-f044-4d8c-b26a-70b321cb7312 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:23.127769 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Attempting to bind port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:44:23.128261 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Attempting to bind port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:44:23.128704 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Attempting to bind port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:23.132883 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-75348992-5e70-4346-a6ea-ec5843f69a98 req-98aaf190-cc6d-4a12-8833-0463b59416cb tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4324119 May 26 14:44:23.134869 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 43, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:44:23.135388 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:23.136469 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:23.136737 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:44:23.137308 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Bound port: 00d2d99f-c77d-4827-9e5d-5d2cf76070fd, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:44:23.137787 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:23.186425 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-cb27be05-6dbc-451e-a14b-c850bcb28e48 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6dd3d162-1705-4ed8-b8bc-cd16968be071 HTTP/1.1" status: 200 len: 217 time: 0.1263509 May 26 14:44:23.231005 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] For port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:44:23.234911 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] For port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=00d2d99f-c77d-4827-9e5d-5d2cf76070fd,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:44:23.243491 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:23.257863 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:23.281295 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-aa5feb03-5ee0-4965-8e62-0a10c3ae9c1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:23.325638 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-c02882b5-f958-484c-8ea2-579ae9d98b1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:23.326274 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-c02882b5-f958-484c-8ea2-579ae9d98b1f service neutron] 10.222.0.79 "GET /v2.0/subnets?id=12c3a6cc-90f7-4a24-9389-58ed3aa06051 HTTP/1.1" status: 200 len: 849 time: 0.1321173 May 26 14:44:23.345629 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f0cee12-f044-4d8c-b26a-70b321cb7312 None None] Pushing event updated for resources: {'Port': ['ID=00d2d99f-c77d-4827-9e5d-5d2cf76070fd,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:23.356397 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-1f0cee12-f044-4d8c-b26a-70b321cb7312 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:23.369714 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:23.380059 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Routers {'062edae0-d41c-480c-8f65-df561aba5774'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:44:23.380779 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:44:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['062edae0-d41c-480c-8f65-df561aba5774'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:23.390731 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-b76c51ee-bf01-4bef-9065-0c47adea2753 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=ed7a1e1a-7ae1-41d4-a402-addaf23d4837&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0554874 May 26 14:44:23.562760 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-4129375e-4836-4210-963c-eabf32bb43a9 service neutron] 10.222.0.79 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1337700 May 26 14:44:23.601196 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40466) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:23.609094 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] Set router 062edae0-d41c-480c-8f65-df561aba5774 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:44:23.645286 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035477a7-d1c7-4fd3-b020-e1512057e0b0 req-a878ae2f-bf9e-4378-8764-3f0c596eb58a tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:23.646960 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-035477a7-d1c7-4fd3-b020-e1512057e0b0 req-a878ae2f-bf9e-4378-8764-3f0c596eb58a tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 944 time: 0.7195249 May 26 14:44:23.738734 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-aa14ae6d-63b3-4d68-b0b2-976cea6ccf4a req-e09733db-ba64-4742-b03c-a2abaf29663f service neutron] 10.222.0.79 "GET /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1672158 May 26 14:44:23.789456 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:23.866409 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:23.899670 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d256d0f7-b3e5-470b-9049-adf3e1632cbc up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:23.900279 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252'}], 'enable_snat': True}, 'gw_port_id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:44:18Z', 'revision_number': 3, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port': {'id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:f4:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:17Z', 'updated_at': '2021-05-26T14:44:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:23.904547 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d3b9123-f94c-4383-ac54-77214956b22f None None] The sync data for ids ['062edae0-d41c-480c-8f65-df561aba5774'] in dv-cinder-774594-6-iscsi is: [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252'}], 'enable_snat': True}, 'gw_port_id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:44:18Z', 'revision_number': 3, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port': {'id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:f4:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:17Z', 'updated_at': '2021-05-26T14:44:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:44:23.910486 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:23.928358 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Usage tracker for resource:security_group_rule and tenant:c255eb9530d34c9da298aaafc7fea82b is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:23.943272 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:23.963080 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-035477a7-d1c7-4fd3-b020-e1512057e0b0 req-ad6261f8-f99f-486c-bcd8-77265d432901 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2089024 May 26 14:44:23.965532 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:23.988960 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d256d0f7-b3e5-470b-9049-adf3e1632cbc triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:23.989357 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.032009 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.087718 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6edfff02-2e00-4da7-8c08-37a887f1f08f {{(pid=98445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:44:24.179275 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.247759 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a76dd4-8144-4486-95e5-8079b253668f req-2b9844a4-5afd-4f15-8945-edc349a70af6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:24.249337 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-44a76dd4-8144-4486-95e5-8079b253668f req-2b9844a4-5afd-4f15-8945-edc349a70af6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.5015552 May 26 14:44:24.292299 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Transition to ACTIVE for port object 6edfff02-2e00-4da7-8c08-37a887f1f08f will not be triggered until provisioned by entity L2. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:24.338949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.368448 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:24.514521 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-44a76dd4-8144-4486-95e5-8079b253668f req-6561afdd-48e7-4254-8571-0cceed8da18c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2505226 May 26 14:44:24.555517 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.688491 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.696753 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Pushing event updated for resources: {'Port': ['ID=6edfff02-2e00-4da7-8c08-37a887f1f08f,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:24.730240 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.362s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:24.738646 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.757413 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-76ea14d1-636b-4d93-98c5-6da6eee9d7de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:24.795897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Allocated IP 172.20.0.1 (9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da/67eca565-c006-4f3d-aa95-7b676123e9ba/0c91d007-7b10-44b3-a3b6-7b6993452f98) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:24.838423 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb737650-45a0-4573-9713-f74540f7aff0,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:24.848482 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:24.857774 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c255eb9530d34c9da298aaafc7fea82b&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2547686 May 26 14:44:24.860687 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40484) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:24.925122 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b419d4b9-c462-4db3-af94-6f6716928ba4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.949058 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Attempting to bind port 6edfff02-2e00-4da7-8c08-37a887f1f08f on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:44:24.949398 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Attempting to bind port 6edfff02-2e00-4da7-8c08-37a887f1f08f by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:44:24.949702 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Attempting to bind port 6edfff02-2e00-4da7-8c08-37a887f1f08f on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:24.952445 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b419d4b9-c462-4db3-af94-6f6716928ba4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:24.971118 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c00e047c-8c3b-4088-9519-08a14488e7f3 req-603c6208-1b01-445d-a53f-b2a05df54afb tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:24.972636 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c00e047c-8c3b-4088-9519-08a14488e7f3 req-603c6208-1b01-445d-a53f-b2a05df54afb tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 944 time: 0.4518089 May 26 14:44:24.973184 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Port 6edfff02-2e00-4da7-8c08-37a887f1f08f on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:44:24.973493 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Attempting to bind port 6edfff02-2e00-4da7-8c08-37a887f1f08f on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:25.008033 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 44, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:44:25.008371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Checking segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:25.008788 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Bound using segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:44:25.009242 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Bound port: 6edfff02-2e00-4da7-8c08-37a887f1f08f, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'}}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:44:25.009588 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.010710 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b419d4b9-c462-4db3-af94-6f6716928ba4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.014535 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d51f76a4-da7f-4295-9d4f-393ef5e58830 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:25.028768 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b419d4b9-c462-4db3-af94-6f6716928ba4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb737650-45a0-4573-9713-f74540f7aff0,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:25.031376 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b419d4b9-c462-4db3-af94-6f6716928ba4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:25.036008 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b419d4b9-c462-4db3-af94-6f6716928ba4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.039700 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b419d4b9-c462-4db3-af94-6f6716928ba4 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/bb737650-45a0-4573-9713-f74540f7aff0 HTTP/1.1" status: 204 len: 168 time: 0.1755507 May 26 14:44:25.126289 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.164133 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c00e047c-8c3b-4088-9519-08a14488e7f3 req-d528df1e-b584-4bf3-ad1c-4ce0f84e3c14 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1785450 May 26 14:44:25.208610 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Transition to ACTIVE for port object 0c91d007-7b10-44b3-a3b6-7b6993452f98 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:25.241085 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] For port 6edfff02-2e00-4da7-8c08-37a887f1f08f, host hv-cinder-77459, cleared binding levels {{(pid=98445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:44:25.245665 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] For port 6edfff02-2e00-4da7-8c08-37a887f1f08f, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6edfff02-2e00-4da7-8c08-37a887f1f08f,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:44:25.253665 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.263984 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-746e3967-b0ca-4657-a899-ab0cba8bda3a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:25.329473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.338944 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:25.339574 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.340983 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] 10.222.0.79 "PUT /v2.0/ports/6edfff02-2e00-4da7-8c08-37a887f1f08f HTTP/1.1" status: 200 len: 1094 time: 2.4148982 May 26 14:44:25.344715 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '932955a5-6814-4e65-b44e-7e16f6c372fe', 'tag': '6edfff02-2e00-4da7-8c08-37a887f1f08f'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:44:25.362776 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb64bdab-9438-4ea0-bea5-b2335e38f379 req-6cc77ff7-6287-4c40-81fc-7f92ab3215e4 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:25.364342 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb64bdab-9438-4ea0-bea5-b2335e38f379 req-6cc77ff7-6287-4c40-81fc-7f92ab3215e4 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 944 time: 0.2515061 May 26 14:44:25.536903 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '932955a5-6814-4e65-b44e-7e16f6c372fe', 'tag': '6edfff02-2e00-4da7-8c08-37a887f1f08f', 'status': 'completed', 'code': 200} May 26 14:44:25.585276 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:25.586241 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Pushing event updated for resources: {'Port': ['ID=6edfff02-2e00-4da7-8c08-37a887f1f08f,revision_number=3']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:25.610070 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:25.613320 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.348s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:25.616398 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.263s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:25.655507 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:25.773034 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb64bdab-9438-4ea0-bea5-b2335e38f379 req-a95f490c-b7e3-4721-a019-3ea662322f7a tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4014137 May 26 14:44:25.837392 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Pushing event updated for resources: {'Port': ['ID=0c91d007-7b10-44b3-a3b6-7b6993452f98,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:25.849304 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:25.855600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-174e2bba-0bc1-4dc1-9c75-3c53f20e63a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:25.857179 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-174e2bba-0bc1-4dc1-9c75-3c53f20e63a1 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 1097 time: 0.3256574 May 26 14:44:25.859219 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.891287 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:25.964407 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 00d2d99f-c77d-4827-9e5d-5d2cf76070fd up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:25.985167 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-e7f15e9d-0478-4a01-8e99-50d91b151cd5 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6edfff02-2e00-4da7-8c08-37a887f1f08f HTTP/1.1" status: 200 len: 217 time: 0.1069064 May 26 14:44:26.030473 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-162cb8f1-3347-4ed9-8ba6-ccd9c83ef03e None None] Provisioning for port 0c91d007-7b10-44b3-a3b6-7b6993452f98 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:26.041231 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-162cb8f1-3347-4ed9-8ba6-ccd9c83ef03e None None] Provisioning complete for port 0c91d007-7b10-44b3-a3b6-7b6993452f98 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:26.041491 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-162cb8f1-3347-4ed9-8ba6-ccd9c83ef03e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:26.080518 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4796b52-fa87-4456-880f-db9c80e3fbc7 req-9c5765a8-16f3-4748-b8ab-b50da94c24d6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:26.082429 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4796b52-fa87-4456-880f-db9c80e3fbc7 req-9c5765a8-16f3-4748-b8ab-b50da94c24d6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.3083384 May 26 14:44:26.092684 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-34e46f49-4723-44ae-b299-826221916d53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:26.094127 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-34e46f49-4723-44ae-b299-826221916d53 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.0932934 May 26 14:44:26.100070 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:26.103218 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-162cb8f1-3347-4ed9-8ba6-ccd9c83ef03e None None] Port 0c91d007-7b10-44b3-a3b6-7b6993452f98 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:44:26.111891 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:26.112335 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:26.170211 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-e497c077-ecab-4189-9312-04066ba5adda service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0684741 May 26 14:44:26.216711 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4796b52-fa87-4456-880f-db9c80e3fbc7 req-4ee7688a-3a8f-4559-ac6a-112ca4c643cc tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177077 May 26 14:44:26.237653 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:26.258760 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=00d2d99f-c77d-4827-9e5d-5d2cf76070fd,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:26.263758 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:26.269975 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:26.347166 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=00d2d99f-c77d-4827-9e5d-5d2cf76070fd,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:26.355010 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:26.420141 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:26.497016 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-f7394602-ebe9-4991-ae6f-2f21d7b81fec service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3163099 May 26 14:44:26.620987 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-097f51ca-3d2f-4b58-9938-7068f6131a8a req-972212c0-426d-46b1-b9f7-d72e8de787af tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:26.622538 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-097f51ca-3d2f-4b58-9938-7068f6131a8a req-972212c0-426d-46b1-b9f7-d72e8de787af tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 944 time: 0.2955363 May 26 14:44:26.785089 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-097f51ca-3d2f-4b58-9938-7068f6131a8a req-6ec8801b-b3a2-49ec-b720-12951fa722e3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1486964 May 26 14:44:26.798421 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a463afe5-3064-4f4e-bf60-e680ce424f77 req-6c3dace2-1b7c-4676-b94e-da7dc667caff service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2916951 May 26 14:44:26.855632 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:26.860285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:26.917486 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-dc1796d8-47b0-4231-9a7d-d4453def0116 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:26.967120 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:27.106709 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Pushing event updated for resources: {'Port': ['ID=0c91d007-7b10-44b3-a3b6-7b6993452f98,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:27.114700 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:27.170231 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 6dd3d162-1705-4ed8-b8bc-cd16968be071 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:44:27.320145 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 6dd3d162-1705-4ed8-b8bc-cd16968be071, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6dd3d162-1705-4ed8-b8bc-cd16968be071,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:27.335299 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '6dd3d162-1705-4ed8-b8bc-cd16968be071', 'network_id': 'ed7a1e1a-7ae1-41d4-a402-addaf23d4837', 'port_id': '6dd3d162-1705-4ed8-b8bc-cd16968be071', 'mac_address': 'fa:16:3e:fc:b3:68', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12c3a6cc-90f7-4a24-9389-58ed3aa06051', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:44:27.354060 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-1b8ff566-89c9-4561-86e2-52e614c4402f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:27.355526 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-1b8ff566-89c9-4561-86e2-52e614c4402f service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 1097 time: 0.3901017 May 26 14:44:27.357781 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:27.367245 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a7ab15-c536-48a7-bb97-5a156b57371f req-f0de122a-afe4-4642-8b0c-57295e9daba3 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:27.368838 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06a7ab15-c536-48a7-bb97-5a156b57371f req-f0de122a-afe4-4642-8b0c-57295e9daba3 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 944 time: 0.4180999 May 26 14:44:27.369674 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:27.404323 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:27.427924 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6dd3d162-1705-4ed8-b8bc-cd16968be071 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:44:27.462415 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 6dd3d162-1705-4ed8-b8bc-cd16968be071, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6dd3d162-1705-4ed8-b8bc-cd16968be071,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:27.464037 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:27.472705 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:27.477173 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3fe766a4-3ce6-40aa-ae69-925a22c07dec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:27.567491 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=6dd3d162-1705-4ed8-b8bc-cd16968be071,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:27.571575 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:27.643999 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-6576272e-aa25-4189-b561-4c4b7f72d981 None None] Provisioning complete for port 0c91d007-7b10-44b3-a3b6-7b6993452f98 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:27.644224 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-6576272e-aa25-4189-b561-4c4b7f72d981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:27.648419 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06a7ab15-c536-48a7-bb97-5a156b57371f req-7fca361e-9b02-4622-bc1d-811c9103b7f2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2300527 May 26 14:44:27.707543 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-6576272e-aa25-4189-b561-4c4b7f72d981 None None] Port 0c91d007-7b10-44b3-a3b6-7b6993452f98 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:44:27.763325 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-8e18d9ad-7a9d-4ee3-a0df-8e4199f5aea8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:27.764883 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-8e18d9ad-7a9d-4ee3-a0df-8e4199f5aea8 service neutron] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 915 time: 0.3645470 May 26 14:44:27.832664 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee63ab99-8d39-48bd-85fd-1bf8f1409ec7 req-5a7d763a-8b94-41c9-9121-dfd1bd92a8bc tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:27.834174 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ee63ab99-8d39-48bd-85fd-1bf8f1409ec7 req-5a7d763a-8b94-41c9-9121-dfd1bd92a8bc tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.4753737 May 26 14:44:27.855954 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-d22fe38f-0226-4518-8ee5-f552fc31293b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=6edfff02-2e00-4da7-8c08-37a887f1f08f HTTP/1.1" status: 200 len: 217 time: 0.0817571 May 26 14:44:27.885037 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Router 062edae0-d41c-480c-8f65-df561aba5774 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:44:27.904678 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 00d2d99f-c77d-4827-9e5d-5d2cf76070fd up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:27.956553 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ee63ab99-8d39-48bd-85fd-1bf8f1409ec7 req-a19d4d01-cee4-4452-a13b-aea842508f11 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1052048 May 26 14:44:28.004330 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:28.004785 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:28.043443 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-fd69daad-c05b-4c20-bc91-8d8a2fc33f0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:28.044917 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-fd69daad-c05b-4c20-bc91-8d8a2fc33f0e service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.1479602 May 26 14:44:28.050637 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['6dd3d162-1705-4ed8-b8bc-cd16968be071'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:44:28.213040 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-768b63f3-8f1b-4aea-bc52-b58a4d5de0d2 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1055489 May 26 14:44:28.262275 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:44:28.277954 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Sync routers for ids ['062edae0-d41c-480c-8f65-df561aba5774'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:44:28.307426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Routers {'062edae0-d41c-480c-8f65-df561aba5774'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:44:28.308527 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:44:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['062edae0-d41c-480c-8f65-df561aba5774'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:28.386902 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] 10.222.0.72 "PUT /v2.0/routers/062edae0-d41c-480c-8f65-df561aba5774/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.6478572 May 26 14:44:28.404502 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519fe8e2-34a2-4e95-b2d3-e8b3046e08be req-05ef9dfb-4eec-49ad-a0bb-2350cd257392 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:28.417273 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-519fe8e2-34a2-4e95-b2d3-e8b3046e08be req-05ef9dfb-4eec-49ad-a0bb-2350cd257392 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 944 time: 0.3048644 May 26 14:44:28.458872 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-0f4fbfcf-5bd1-4ace-8203-a97858e1a550 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2305398 May 26 14:44:28.470348 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-519fe8e2-34a2-4e95-b2d3-e8b3046e08be req-68953a68-543d-4fd1-9043-0a99fc100751 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519476 May 26 14:44:28.495332 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40620) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:28.576791 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Set router 062edae0-d41c-480c-8f65-df561aba5774 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:44:28.644933 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4abdabe-c9aa-4a5a-8dce-e11ddbafbd2b req-49343008-9251-47c1-9cf1-06f58a2cb5d8 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1733725 May 26 14:44:28.658129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:28.673481 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:28.694800 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Usage tracker for resource:security_group_rule and tenant:d753b564ace647aaac0b644b44256f62 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:28.698118 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:28.707888 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:28.807313 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:28.819605 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:28.848300 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:28.874867 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d753b564ace647aaac0b644b44256f62&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3777881 May 26 14:44:28.875451 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40642) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:28.904618 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-473ea4ee-3122-4d54-bc52-afd4bab82847 req-aa0e7364-a8a7-420d-9d88-5698eebc977d tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:28.906263 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-473ea4ee-3122-4d54-bc52-afd4bab82847 req-aa0e7364-a8a7-420d-9d88-5698eebc977d tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 945 time: 0.1172354 May 26 14:44:28.946911 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c95c154b-36fd-4ef0-918c-1546f1f97188,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:28.957523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:28.962252 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252'}], 'enable_snat': True}, 'gw_port_id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:44:26Z', 'revision_number': 4, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port': {'id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:f4:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:17Z', 'updated_at': '2021-05-26T14:44:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '0c91d007-7b10-44b3-a3b6-7b6993452f98', 'name': '', 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'mac_address': 'fa:16:3e:33:5b:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_interface', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': '67eca565-c006-4f3d-aa95-7b676123e9ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:24Z', 'updated_at': '2021-05-26T14:44:26Z', 'revision_number': 2, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'subnets': [{'id': '67eca565-c006-4f3d-aa95-7b676123e9ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:28.969751 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Checking router: 062edae0-d41c-480c-8f65-df561aba5774 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:44:28.970116 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Updating router 062edae0-d41c-480c-8f65-df561aba5774 port 0c91d007-7b10-44b3-a3b6-7b6993452f98 binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:44:29.015390 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-473ea4ee-3122-4d54-bc52-afd4bab82847 req-12120eaf-0992-443d-b9b3-8efb4a0dafb5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0965505 May 26 14:44:29.038599 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.041060 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e0dba12f-8d56-4fb7-9dcd-20484e4442c0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.124255 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e0dba12f-8d56-4fb7-9dcd-20484e4442c0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.209484 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e0dba12f-8d56-4fb7-9dcd-20484e4442c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.217986 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2390504c-1f17-4376-a7da-90c244aef27a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:29.237682 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0dba12f-8d56-4fb7-9dcd-20484e4442c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c95c154b-36fd-4ef0-918c-1546f1f97188,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:29.244405 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e0dba12f-8d56-4fb7-9dcd-20484e4442c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:29.248560 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e0dba12f-8d56-4fb7-9dcd-20484e4442c0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.249955 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e0dba12f-8d56-4fb7-9dcd-20484e4442c0 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/c95c154b-36fd-4ef0-918c-1546f1f97188 HTTP/1.1" status: 204 len: 168 time: 0.3711574 May 26 14:44:29.290937 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2bd7dcf-abbf-4c61-bd93-58e6acd667b0 req-744f830f-2cbf-469c-9d47-4ecb20efbc48 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:29.292832 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c2bd7dcf-abbf-4c61-bd93-58e6acd667b0 req-744f830f-2cbf-469c-9d47-4ecb20efbc48 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1062260 May 26 14:44:29.351864 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c2bd7dcf-abbf-4c61-bd93-58e6acd667b0 req-924b3055-c2c0-4520-a3b3-8e28708c6ce4 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520504 May 26 14:44:29.476549 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.491572 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Transition to ACTIVE for port object 0c91d007-7b10-44b3-a3b6-7b6993452f98 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:29.500918 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.506295 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-708fc265-c610-4de8-9857-f5ecc2864809 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:29.786114 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c85ac9-60e3-4b30-ad85-42dabb06ae66 req-2075db26-d3ed-4603-b903-8e88f9440ec9 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:29.788110 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c85ac9-60e3-4b30-ad85-42dabb06ae66 req-2075db26-d3ed-4603-b903-8e88f9440ec9 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 944 time: 0.1349571 May 26 14:44:29.825023 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f81a227-11f9-4d84-9b4b-57a5a3a5a50a None None] Pushing event updated for resources: {'Port': ['ID=0c91d007-7b10-44b3-a3b6-7b6993452f98,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:29.833487 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3f81a227-11f9-4d84-9b4b-57a5a3a5a50a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.327s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:29.872950 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Attempting to bind port 0c91d007-7b10-44b3-a3b6-7b6993452f98 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:44:29.873320 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Attempting to bind port 0c91d007-7b10-44b3-a3b6-7b6993452f98 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:44:29.873680 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Attempting to bind port 0c91d007-7b10-44b3-a3b6-7b6993452f98 on network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:44:29.880413 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 44, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:44:29.880855 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Checking segment: {'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:44:29.881194 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.881582 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Bound using segment: {'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:44:29.882093 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Bound port: 0c91d007-7b10-44b3-a3b6-7b6993452f98, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4adb3784-0b4e-4b28-bcc1-ba118c24af86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1139, 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:44:29.882525 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:29.993693 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98c85ac9-60e3-4b30-ad85-42dabb06ae66 req-720afd7d-723b-4468-a517-9769783a3c2b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1934929 May 26 14:44:30.017939 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] For port 0c91d007-7b10-44b3-a3b6-7b6993452f98, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:44:30.021641 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] For port 0c91d007-7b10-44b3-a3b6-7b6993452f98, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=0c91d007-7b10-44b3-a3b6-7b6993452f98,segment=NetworkSegment(4adb3784-0b4e-4b28-bcc1-ba118c24af86),segment_id=4adb3784-0b4e-4b28-bcc1-ba118c24af86)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:44:30.028532 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:30.038886 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-dbebab3e-6521-4250-9c28-d3cf0c68887d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:30.122880 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Routers {'062edae0-d41c-480c-8f65-df561aba5774'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:44:30.123522 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:44:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['062edae0-d41c-480c-8f65-df561aba5774'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:30.286102 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f81a227-11f9-4d84-9b4b-57a5a3a5a50a None None] Pushing event updated for resources: {'Port': ['ID=0c91d007-7b10-44b3-a3b6-7b6993452f98,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:30.396959 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3ee5ea9-7e16-4d04-ac96-db2ac1ccdc7c req-6e695bce-68f4-434e-b997-0970b6d08c5f tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:30.398899 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d3ee5ea9-7e16-4d04-ac96-db2ac1ccdc7c req-6e695bce-68f4-434e-b997-0970b6d08c5f tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 945 time: 0.1544919 May 26 14:44:30.455765 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3f81a227-11f9-4d84-9b4b-57a5a3a5a50a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.416s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:30.496449 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d3ee5ea9-7e16-4d04-ac96-db2ac1ccdc7c req-605a6992-f513-41bc-8d8b-fea6686cebea tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903850 May 26 14:44:30.550954 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] Set router 062edae0-d41c-480c-8f65-df561aba5774 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:44:30.770918 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76cc9b2e-786d-433b-b742-8136948ac7d0 req-06f8c2ce-398b-4189-9678-92f7045ff455 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:30.772675 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-76cc9b2e-786d-433b-b742-8136948ac7d0 req-06f8c2ce-398b-4189-9678-92f7045ff455 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1258354 May 26 14:44:30.870155 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-76cc9b2e-786d-433b-b742-8136948ac7d0 req-27d183e5-68d8-4173-a76e-bb67a2ff31a6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865433 May 26 14:44:31.129450 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252'}], 'enable_snat': True}, 'gw_port_id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:44:26Z', 'revision_number': 4, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port': {'id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:f4:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:17Z', 'updated_at': '2021-05-26T14:44:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '0c91d007-7b10-44b3-a3b6-7b6993452f98', 'name': '', 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'mac_address': 'fa:16:3e:33:5b:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_interface', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': '67eca565-c006-4f3d-aa95-7b676123e9ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:24Z', 'updated_at': '2021-05-26T14:44:30Z', 'revision_number': 4, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'subnets': [{'id': '67eca565-c006-4f3d-aa95-7b676123e9ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:44:31.136929 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5be36576-4fb5-46a8-8dbf-d10fa3ad38e6 None None] The sync data for ids ['062edae0-d41c-480c-8f65-df561aba5774'] in dv-cinder-774594-6-iscsi is: [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252'}], 'enable_snat': True}, 'gw_port_id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:44:26Z', 'revision_number': 4, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port': {'id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:f4:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:17Z', 'updated_at': '2021-05-26T14:44:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '0c91d007-7b10-44b3-a3b6-7b6993452f98', 'name': '', 'network_id': '9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'mac_address': 'fa:16:3e:33:5b:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_interface', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': '67eca565-c006-4f3d-aa95-7b676123e9ba', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:24Z', 'updated_at': '2021-05-26T14:44:30Z', 'revision_number': 4, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'subnets': [{'id': '67eca565-c006-4f3d-aa95-7b676123e9ba', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:44:31.225426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 6edfff02-2e00-4da7-8c08-37a887f1f08f details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:44:31.231388 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 6dd3d162-1705-4ed8-b8bc-cd16968be071 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:31.406969 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20834e0b-b270-4c84-a79b-f4b05a2a735a req-eceb0328-c9a9-483f-a12f-3f130c7191ee tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:31.415235 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-20834e0b-b270-4c84-a79b-f4b05a2a735a req-eceb0328-c9a9-483f-a12f-3f130c7191ee tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 944 time: 0.1648493 May 26 14:44:31.486778 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-20834e0b-b270-4c84-a79b-f4b05a2a735a req-93c3f40a-612d-4842-8be1-8240e5ce494c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701711 May 26 14:44:31.534554 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 6edfff02-2e00-4da7-8c08-37a887f1f08f, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6edfff02-2e00-4da7-8c08-37a887f1f08f,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:31.563133 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 6dd3d162-1705-4ed8-b8bc-cd16968be071 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:31.574343 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 6dd3d162-1705-4ed8-b8bc-cd16968be071 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:31.574343 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:31.638943 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '6edfff02-2e00-4da7-8c08-37a887f1f08f', 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'port_id': '6edfff02-2e00-4da7-8c08-37a887f1f08f', 'mac_address': 'fa:16:3e:bd:48:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e482f08e-dc41-4d58-b9cf-6de9798b0585', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:44:31.749265 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:31.825699 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6edfff02-2e00-4da7-8c08-37a887f1f08f {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:44:31.862291 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecedd2e-37f7-448b-9ec9-e715e6c8564a req-5a08733c-ae01-4372-a0c1-11b67baf8cd7 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:31.869969 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 6edfff02-2e00-4da7-8c08-37a887f1f08f, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6edfff02-2e00-4da7-8c08-37a887f1f08f,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:31.871129 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:31.889906 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4ecedd2e-37f7-448b-9ec9-e715e6c8564a req-5a08733c-ae01-4372-a0c1-11b67baf8cd7 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 945 time: 0.1577606 May 26 14:44:31.901406 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:31.912978 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:31.986719 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4ecedd2e-37f7-448b-9ec9-e715e6c8564a req-407acbf9-f533-42c2-b465-b6aafdede713 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0949607 May 26 14:44:32.169252 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '863c827c-cd8f-4809-9bdf-ab60f8fb191a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6dd3d162-1705-4ed8-b8bc-cd16968be071'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:44:32.231235 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=6edfff02-2e00-4da7-8c08-37a887f1f08f,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:32.234060 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 0c91d007-7b10-44b3-a3b6-7b6993452f98 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:32.310670 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 6dd3d162-1705-4ed8-b8bc-cd16968be071, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6dd3d162-1705-4ed8-b8bc-cd16968be071,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:32.311916 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.399s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:32.323977 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '863c827c-cd8f-4809-9bdf-ab60f8fb191a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6dd3d162-1705-4ed8-b8bc-cd16968be071', 'code': 200} May 26 14:44:32.341677 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:32.361731 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-1aeef2b8-dce1-4bc1-9f24-7b48f65cd53e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:32.384922 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f015b828-1c61-4c79-91a9-905ba3c91869 req-1cabb1f4-3c2e-48d2-aeed-4b991ab86d50 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:32.388222 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f015b828-1c61-4c79-91a9-905ba3c91869 req-1cabb1f4-3c2e-48d2-aeed-4b991ab86d50 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1796389 May 26 14:44:32.511881 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f015b828-1c61-4c79-91a9-905ba3c91869 req-65b7f188-01ce-4b98-b556-09976fdf5908 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138752 May 26 14:44:32.515731 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['6edfff02-2e00-4da7-8c08-37a887f1f08f'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:44:32.640012 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=6dd3d162-1705-4ed8-b8bc-cd16968be071,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:32.645471 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:32.657596 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 0c91d007-7b10-44b3-a3b6-7b6993452f98 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:32.666577 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 0c91d007-7b10-44b3-a3b6-7b6993452f98 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:32.666952 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:33.025349 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-092fafe3-acac-412c-9a4c-a82f528316d9 req-79ead0e9-72c3-45b1-b650-b064c99f0c05 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:33.034331 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-092fafe3-acac-412c-9a4c-a82f528316d9 req-79ead0e9-72c3-45b1-b650-b064c99f0c05 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 945 time: 0.3041992 May 26 14:44:33.054692 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:33.070522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ca6727-6dfe-4d87-841f-438a1c8fa2e0 req-0b3c0482-ddd2-4ac3-aac7-bb3f3a0c32d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:33.072740 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d0ca6727-6dfe-4d87-841f-438a1c8fa2e0 req-0b3c0482-ddd2-4ac3-aac7-bb3f3a0c32d5 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 1099 time: 0.2692912 May 26 14:44:33.130529 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 0c91d007-7b10-44b3-a3b6-7b6993452f98, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=0c91d007-7b10-44b3-a3b6-7b6993452f98,segment=NetworkSegment(4adb3784-0b4e-4b28-bcc1-ba118c24af86),segment_id=4adb3784-0b4e-4b28-bcc1-ba118c24af86)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:33.138678 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:33.140722 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3fe766a4-3ce6-40aa-ae69-925a22c07dec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:33.141655 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-092fafe3-acac-412c-9a4c-a82f528316d9 req-73acb3e4-07fa-47d5-a411-c140a36497a4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1059308 May 26 14:44:33.195893 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d0ca6727-6dfe-4d87-841f-438a1c8fa2e0 req-f4f3c208-1e3e-4f70-b364-35aa79250345 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000688 May 26 14:44:33.291638 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=0c91d007-7b10-44b3-a3b6-7b6993452f98,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:33.298344 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:33.353446 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c414360-47be-4fc3-a66e-0ed07633e597 req-f256604a-091b-4675-ba08-27d20cf23e69 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:33.362463 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c414360-47be-4fc3-a66e-0ed07633e597 req-f256604a-091b-4675-ba08-27d20cf23e69 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 946 time: 0.1190956 May 26 14:44:33.431132 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c414360-47be-4fc3-a66e-0ed07633e597 req-46a9475c-7c1c-4b4b-a694-b2952efb35fa tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598834 May 26 14:44:33.604832 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40768) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:33.750016 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ebfd2b6-5dd5-4dd1-b6be-84e3625da617 req-8126bd40-ed34-48b1-8a2b-e69cd19e72f9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:33.757518 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4ebfd2b6-5dd5-4dd1-b6be-84e3625da617 req-8126bd40-ed34-48b1-8a2b-e69cd19e72f9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0979822 May 26 14:44:33.765928 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:33.782257 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:33.787221 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Usage tracker for resource:security_group_rule and tenant:230569703cf840c89cae824b7e80dce0 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:33.790764 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:33.797238 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:33.811933 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4ebfd2b6-5dd5-4dd1-b6be-84e3625da617 req-ef24bead-2d0b-4707-99bc-4e6f859a72bc tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533390 May 26 14:44:33.903434 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 0c91d007-7b10-44b3-a3b6-7b6993452f98 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:33.914144 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:33.919223 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:33.927865 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a1fea191-ffa4-4211-a44c-635fae007a26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:33.961250 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=21f17731-f6d7-43e2-8fb5-1c1b7a179dc7,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:33.979637 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:34.000174 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 40776) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:34.000611 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=230569703cf840c89cae824b7e80dce0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3930643 May 26 14:44:34.024047 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 0c91d007-7b10-44b3-a3b6-7b6993452f98 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:34.024047 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:34.111555 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5d8b8e30-92e6-4179-9231-f1a881987541 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:34.141612 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5d8b8e30-92e6-4179-9231-f1a881987541 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:34.252452 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5d8b8e30-92e6-4179-9231-f1a881987541 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:34.257069 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7ce7aeca-539d-4277-bd36-9c30b20c2737 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:34.271484 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8b8e30-92e6-4179-9231-f1a881987541 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21f17731-f6d7-43e2-8fb5-1c1b7a179dc7,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:34.281474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5d8b8e30-92e6-4179-9231-f1a881987541 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:34.285234 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5d8b8e30-92e6-4179-9231-f1a881987541 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:34.289570 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-5d8b8e30-92e6-4179-9231-f1a881987541 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/21f17731-f6d7-43e2-8fb5-1c1b7a179dc7 HTTP/1.1" status: 204 len: 168 time: 0.2869079 May 26 14:44:34.390898 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788b6ec1-b391-4d19-bb98-fcf43977937a req-4b2b79d7-8f0f-4f22-ac7f-ee15e6f07695 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:34.398223 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-788b6ec1-b391-4d19-bb98-fcf43977937a req-4b2b79d7-8f0f-4f22-ac7f-ee15e6f07695 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 945 time: 0.1073170 May 26 14:44:34.450942 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-788b6ec1-b391-4d19-bb98-fcf43977937a req-dedc7668-2314-4f9f-ae64-f4ed3d1beb7e tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517848 May 26 14:44:34.744327 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40794) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:34.788709 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:34.796875 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60933ad-e6c9-4279-972f-f8e6a1410fd5 req-781ace86-6de5-45bf-9a39-36b5e1756b9f tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:34.827909 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e60933ad-e6c9-4279-972f-f8e6a1410fd5 req-781ace86-6de5-45bf-9a39-36b5e1756b9f tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 946 time: 0.1973488 May 26 14:44:34.868369 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:34.879386 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Usage tracker for resource:security_group_rule and tenant:cb6aaf5fb7144032985bb73045971c36 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:34.885866 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:34.900018 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e60933ad-e6c9-4279-972f-f8e6a1410fd5 req-27f86332-fcaf-4392-af16-c63a9fff4ea8 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711954 May 26 14:44:34.906366 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:35.033507 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.041644 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.055901 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b419d4b9-c462-4db3-af94-6f6716928ba4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:35.081521 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ed0d73-385b-447c-82b6-e64abadb8329 req-f92d36db-4527-43a6-89b1-7291072b6364 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:35.083175 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e2ed0d73-385b-447c-82b6-e64abadb8329 req-f92d36db-4527-43a6-89b1-7291072b6364 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1082215 May 26 14:44:35.105500 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d551e916-4841-4860-9e1a-55a44ea98d12,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:35.109202 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:35.117798 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=cb6aaf5fb7144032985bb73045971c36&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3723497 May 26 14:44:35.118805 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 40806) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:35.187912 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e2ed0d73-385b-447c-82b6-e64abadb8329 req-f59d75f7-6a36-4c04-af2d-f3ceef803f07 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836439 May 26 14:44:35.244066 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 6edfff02-2e00-4da7-8c08-37a887f1f08f up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:44:35.265673 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-85db4551-b675-4cc9-9dfd-3b2c2004b60f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.299643 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-85db4551-b675-4cc9-9dfd-3b2c2004b60f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.331679 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 6edfff02-2e00-4da7-8c08-37a887f1f08f completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:35.338405 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 6edfff02-2e00-4da7-8c08-37a887f1f08f triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:35.339141 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.409281 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-85db4551-b675-4cc9-9dfd-3b2c2004b60f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.424132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-10085582-089b-4b58-b964-1be2927f7d24 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:35.441185 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85db4551-b675-4cc9-9dfd-3b2c2004b60f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d551e916-4841-4860-9e1a-55a44ea98d12,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:35.443927 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-85db4551-b675-4cc9-9dfd-3b2c2004b60f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.445609 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-85db4551-b675-4cc9-9dfd-3b2c2004b60f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/d551e916-4841-4860-9e1a-55a44ea98d12 HTTP/1.1" status: 204 len: 168 time: 0.3257680 May 26 14:44:35.446971 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-85db4551-b675-4cc9-9dfd-3b2c2004b60f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:35.529129 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.564853 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '932955a5-6814-4e65-b44e-7e16f6c372fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6edfff02-2e00-4da7-8c08-37a887f1f08f'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:44:35.575120 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 6edfff02-2e00-4da7-8c08-37a887f1f08f, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6edfff02-2e00-4da7-8c08-37a887f1f08f,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:35.584408 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:35.588474 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:35.663137 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=6edfff02-2e00-4da7-8c08-37a887f1f08f,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:35.666948 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '932955a5-6814-4e65-b44e-7e16f6c372fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6edfff02-2e00-4da7-8c08-37a887f1f08f', 'code': 200} May 26 14:44:35.667668 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:35.757732 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21351986-c7b3-4ed3-b9bd-b2d67ee68dcf req-0e55e91b-e369-4838-a797-5aec8bf11c9c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:35.765381 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21351986-c7b3-4ed3-b9bd-b2d67ee68dcf req-0e55e91b-e369-4838-a797-5aec8bf11c9c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 946 time: 0.1083002 May 26 14:44:35.834497 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21351986-c7b3-4ed3-b9bd-b2d67ee68dcf req-ae00b062-0b5e-4137-9fa8-e7fd6771eef4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655816 May 26 14:44:36.075537 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cea4e14-a00b-4830-9376-96a0efa0f544 req-37fd9ce0-7b5a-4ba0-9ecf-54a99ab87a57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:36.077415 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1cea4e14-a00b-4830-9376-96a0efa0f544 req-37fd9ce0-7b5a-4ba0-9ecf-54a99ab87a57 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 1099 time: 0.1222661 May 26 14:44:36.189419 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1cea4e14-a00b-4830-9376-96a0efa0f544 req-20ff24ce-4f7a-4011-b19b-650be00c48ef service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0833673 May 26 14:44:36.235825 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13217783-9915-42d5-872a-462c6d3c3e96 req-8f22684c-78ad-4ced-bc61-21ab481c5afe tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:36.237391 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13217783-9915-42d5-872a-462c6d3c3e96 req-8f22684c-78ad-4ced-bc61-21ab481c5afe tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 946 time: 0.1016698 May 26 14:44:36.291677 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13217783-9915-42d5-872a-462c6d3c3e96 req-f9dc3d24-a747-431b-a4d1-89177f047ec9 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473588 May 26 14:44:36.400639 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8333fe-d49f-42b2-9c8f-aa553c47e799 req-e9675531-0941-460c-903d-13a6098822c8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:36.402765 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5c8333fe-d49f-42b2-9c8f-aa553c47e799 req-e9675531-0941-460c-903d-13a6098822c8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1098623 May 26 14:44:36.467117 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5c8333fe-d49f-42b2-9c8f-aa553c47e799 req-43d05ab2-fccb-4e72-b54f-129d4a214932 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560265 May 26 14:44:37.131625 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a172fe-1012-489a-a199-3ff22686f50b req-c07c5981-d35c-4fd7-86f6-4baac3f28b1f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:37.140082 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-08a172fe-1012-489a-a199-3ff22686f50b req-c07c5981-d35c-4fd7-86f6-4baac3f28b1f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 946 time: 0.1217878 May 26 14:44:37.425880 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-08a172fe-1012-489a-a199-3ff22686f50b req-8c75939e-50ec-4c02-8de5-118ab8960dde tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2843266 May 26 14:44:37.735090 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2937e0de-8c1e-4979-b430-d5d39e529079 req-de81302c-72a6-441f-b132-77604ea63d5e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:37.743595 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2937e0de-8c1e-4979-b430-d5d39e529079 req-de81302c-72a6-441f-b132-77604ea63d5e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1251678 May 26 14:44:37.818910 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2937e0de-8c1e-4979-b430-d5d39e529079 req-a3da0666-3090-43cf-8601-24dfd44fc7d3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740905 May 26 14:44:38.171114 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df72117-21ce-424f-b81b-3d9cf771e897 req-3f6faeec-8055-4878-88e1-dd2babf437d4 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:38.173595 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2df72117-21ce-424f-b81b-3d9cf771e897 req-3f6faeec-8055-4878-88e1-dd2babf437d4 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 946 time: 0.1293993 May 26 14:44:38.238225 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2df72117-21ce-424f-b81b-3d9cf771e897 req-ee9e7579-aaa9-4e7a-b952-8ab43ce6c703 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503042 May 26 14:44:38.662951 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafcd1dd-7524-424d-aed3-250a64d5656c req-9b5f27d6-eb2f-4853-89ff-098b2c3f92d6 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:38.664878 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fafcd1dd-7524-424d-aed3-250a64d5656c req-9b5f27d6-eb2f-4853-89ff-098b2c3f92d6 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 946 time: 0.1094673 May 26 14:44:38.794599 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fafcd1dd-7524-424d-aed3-250a64d5656c req-54c2b3e2-a106-4e37-b6db-86efa1881042 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1229846 May 26 14:44:39.068101 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9cb4222-ab8d-4f7b-acf0-86ec1df53fc5 req-d9cb88de-bb08-436b-96c8-ce27cd759a7a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:39.069839 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d9cb4222-ab8d-4f7b-acf0-86ec1df53fc5 req-d9cb88de-bb08-436b-96c8-ce27cd759a7a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0879877 May 26 14:44:39.137847 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d9cb4222-ab8d-4f7b-acf0-86ec1df53fc5 req-5a2a4708-ca21-417a-9f75-c2a8303c2bc7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596826 May 26 14:44:39.478071 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa079fa8-6de7-44eb-aa33-99bb5ebdb829 req-f0ef0ac4-4ca8-4404-938a-f7d52c01da8e tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:39.479644 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa079fa8-6de7-44eb-aa33-99bb5ebdb829 req-f0ef0ac4-4ca8-4404-938a-f7d52c01da8e tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 946 time: 0.0999641 May 26 14:44:39.573722 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa079fa8-6de7-44eb-aa33-99bb5ebdb829 req-4b1d514b-e6f6-41aa-a232-4b8cef548073 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781865 May 26 14:44:40.380031 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc92ca1-87d9-4384-aac4-251ee55d78a7 req-080495d3-1693-4cc8-a634-77a44a308b05 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:40.381586 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2cc92ca1-87d9-4384-aac4-251ee55d78a7 req-080495d3-1693-4cc8-a634-77a44a308b05 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1111484 May 26 14:44:40.459977 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2cc92ca1-87d9-4384-aac4-251ee55d78a7 req-6e4dd21a-c9f3-4f9d-9bd9-f32866e6a5bb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724134 May 26 14:44:43.814993 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b240093-b939-46de-b333-39e92b64e3cd req-05fe89a8-a770-4a2d-874d-79dbd0333bcd tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:43.816419 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8b240093-b939-46de-b333-39e92b64e3cd req-05fe89a8-a770-4a2d-874d-79dbd0333bcd tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.79 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 946 time: 0.0971036 May 26 14:44:44.034907 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Deleting port 6dd3d162-1705-4ed8-b8bc-cd16968be071 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:44:44.035257 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:44.075360 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9434c681-7cfe-4320-8891-c455bf106c8b req-ecbae5e9-54a2-4bca-a6d5-2b1ca0d8db0c tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:44.076891 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9434c681-7cfe-4320-8891-c455bf106c8b req-ecbae5e9-54a2-4bca-a6d5-2b1ca0d8db0c tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 946 time: 0.1453915 May 26 14:44:44.208884 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9434c681-7cfe-4320-8891-c455bf106c8b req-ec957c59-3ad0-4576-8cba-a75c7c8fb4a1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/security-groups?id=deb69b02-d196-40d2-94bd-23224ce4150e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844955 May 26 14:44:44.240876 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] For port 6dd3d162-1705-4ed8-b8bc-cd16968be071, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6dd3d162-1705-4ed8-b8bc-cd16968be071,segment=NetworkSegment(d3f9151f-5909-4b72-bd16-08d37a5eb84a),segment_id=d3f9151f-5909-4b72-bd16-08d37a5eb84a)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:44:44.241444 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:44.433168 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Calling delete_port for 6dd3d162-1705-4ed8-b8bc-cd16968be071 owned by compute:nova {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:44:44.562756 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b9464c-d90c-4528-8292-6c37c8743db8 req-06a22c87-e305-4831-8b39-334c43b6a07f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:44.567800 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66b9464c-d90c-4528-8292-6c37c8743db8 req-06a22c87-e305-4831-8b39-334c43b6a07f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.2481420 May 26 14:44:44.626816 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66b9464c-d90c-4528-8292-6c37c8743db8 req-a9757d3a-dde7-4510-855e-9ab7e0e9286c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564919 May 26 14:44:44.876183 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:44.888209 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e779c08e-cb2f-40ff-a53b-cf90b9d92e95 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:44.975188 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Pushing event deleted for resources: {'Port': ['ID=6dd3d162-1705-4ed8-b8bc-cd16968be071,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:45.033651 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.034008 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.034391 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.034741 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.035081 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.035420 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.035767 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.036100 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.036435 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.036768 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.037105 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.037440 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:45.046860 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:45.058923 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-2ad780b6-05e0-4ff3-b92d-bf6ffbbbe0c8 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:45.059620 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-2ad780b6-05e0-4ff3-b92d-bf6ffbbbe0c8 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Synchronizing usage tracker for tenant:3defae92a9a1480c9278cae3445f9617 on resource:network {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:44:45.062528 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] No DVR routers for this DVR port 6dd3d162-1705-4ed8-b8bc-cd16968be071 on host hv-cinder-77459 {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:44:45.066258 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:45.068762 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '863c827c-cd8f-4809-9bdf-ab60f8fb191a', 'name': 'network-vif-deleted', 'tag': '6dd3d162-1705-4ed8-b8bc-cd16968be071'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:44:45.083528 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8b240093-b939-46de-b333-39e92b64e3cd req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.79 "DELETE /v2.0/ports/6dd3d162-1705-4ed8-b8bc-cd16968be071 HTTP/1.1" status: 204 len: 173 time: 1.2410226 May 26 14:44:45.101243 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-2ad780b6-05e0-4ff3-b92d-bf6ffbbbe0c8 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Unset dirty status for tenant:3defae92a9a1480c9278cae3445f9617 on resource:network {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:44:45.103631 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-2ad780b6-05e0-4ff3-b92d-bf6ffbbbe0c8 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/networks?id=f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 200 len: 815 time: 0.4239156 May 26 14:44:45.123458 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '863c827c-cd8f-4809-9bdf-ab60f8fb191a', 'name': 'network-vif-deleted', 'tag': '6dd3d162-1705-4ed8-b8bc-cd16968be071', 'status': 'completed', 'code': 200} May 26 14:44:45.124702 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-a8a32b47-9c3c-4531-bf3e-3fd96f015fc1 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/quotas/3defae92a9a1480c9278cae3445f9617 HTTP/1.1" status: 200 len: 375 time: 0.0125651 May 26 14:44:45.215842 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-6365ef16-2ee6-4f1b-844b-11f7d8cc301e tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=3defae92a9a1480c9278cae3445f9617&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0842116 May 26 14:44:45.305681 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 6dd3d162-1705-4ed8-b8bc-cd16968be071 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:44:45.347428 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 6dd3d162-1705-4ed8-b8bc-cd16968be071 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:44:45.347695 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 6dd3d162-1705-4ed8-b8bc-cd16968be071 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:44:45.393237 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-8b2fb33c-34dc-4fca-bac0-da617130b6b6 req-b094d867-4d11-4125-9206-6538b361dc25 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Synchronizing usage tracker for tenant:1a5c67cf2b5f455180b60afe8233d534 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:44:45.415343 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-71a5bbc0-9758-40ad-89e1-311b5cc5b8a7 service neutron] 10.222.0.72 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1875517 May 26 14:44:45.442001 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-8b2fb33c-34dc-4fca-bac0-da617130b6b6 req-b094d867-4d11-4125-9206-6538b361dc25 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Unset dirty status for tenant:1a5c67cf2b5f455180b60afe8233d534 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:44:45.443187 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8b2fb33c-34dc-4fca-bac0-da617130b6b6 req-b094d867-4d11-4125-9206-6538b361dc25 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] 10.222.0.72 "GET /v2.0/ports?device_id=863c827c-cd8f-4809-9bdf-ab60f8fb191a HTTP/1.1" status: 200 len: 210 time: 0.0992391 May 26 14:44:45.552608 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-ca302e0a-df2b-406a-acee-d34163878aef service neutron] 10.222.0.72 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1306286 May 26 14:44:45.697218 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0055145d-7b62-4af4-a9a3-a02a5e4d88af req-166af9fc-a108-4a89-887c-52654a64938f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:45.702344 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0055145d-7b62-4af4-a9a3-a02a5e4d88af req-166af9fc-a108-4a89-887c-52654a64938f service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 1099 time: 0.0805326 May 26 14:44:45.748622 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0055145d-7b62-4af4-a9a3-a02a5e4d88af req-fc859cd1-ea3c-4dbd-8dc5-eb5382143379 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409882 May 26 14:44:45.839120 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3b374204-912e-465b-ab9e-283b0baf3044 req-1a3ddb50-c042-496f-a4f5-9f8ca61607bf tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 210 time: 0.0556569 May 26 14:44:45.877085 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0194939-2a53-4d79-b8bc-76f1a48ebc7d req-bf5e06e8-47cd-40ea-81ba-12c73ab83697 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:45.884446 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e0194939-2a53-4d79-b8bc-76f1a48ebc7d req-bf5e06e8-47cd-40ea-81ba-12c73ab83697 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1324081 May 26 14:44:45.925108 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e0194939-2a53-4d79-b8bc-76f1a48ebc7d req-64f38d9e-9f39-4794-be45-fb7bf2f98e0f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396965 May 26 14:44:46.996038 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-43f4d203-86c7-4c2b-a104-c088470672f1 req-7e60e306-80a5-4bf8-8900-bb890181802e tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 210 time: 0.0488777 May 26 14:44:47.437413 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc63555-9fe2-41ae-b5f7-66183f0ef373 req-c1988c36-3505-4d91-8163-e30d8ce6cf98 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:47.445269 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8fc63555-9fe2-41ae-b5f7-66183f0ef373 req-c1988c36-3505-4d91-8163-e30d8ce6cf98 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.2431552 May 26 14:44:47.553632 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8fc63555-9fe2-41ae-b5f7-66183f0ef373 req-87e3ded6-1ad0-4fc0-b0f9-f829487e7bfa tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1048162 May 26 14:44:47.595339 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-6eb50b90-3450-488b-bd3b-d8a6ff16ea55 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:47.597168 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-6eb50b90-3450-488b-bd3b-d8a6ff16ea55 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.79 "GET /v2.0/networks?id=f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 200 len: 815 time: 0.3163841 May 26 14:44:47.641901 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'port': {'device_id': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'admin_state_up': True, 'tenant_id': '3defae92a9a1480c9278cae3445f9617'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:44:47.809705 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:47.813485 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:port and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:47.816285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:47.821924 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:47.835341 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Made reservation on behalf of 3defae92a9a1480c9278cae3445f9617 for: {'port': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:44:47.839317 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:47.898586 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 41108) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:48.033370 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Allocated IP 172.20.0.9 (f37261a9-5fa8-47e1-88e3-772578212058/466228a3-069c-4ecc-9790-37e83a8604c9/ac07176b-6df8-402b-be15-ef2328d925a9) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:44:48.045679 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.064731 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:48.069391 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Usage tracker for resource:security_group_rule and tenant:07073da525d7417aaa7682a78f9102cc is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:48.072537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:48.079169 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:48.166286 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.171177 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.185047 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-cdf39e3a-2b52-426c-9f6d-7ffaf85eaf03 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:48.221905 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=07073da525d7417aaa7682a78f9102cc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3221929 May 26 14:44:48.224719 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 41138) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:48.236565 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e99130fd-d70e-4de2-93c0-f208065b334f,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:48.252824 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.253182 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.253573 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.253852 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.254434 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.254770 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.255133 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.255450 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.255789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.256122 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.256468 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.256792 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:44:48.261583 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:48.307571 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5ccad7b7-b40f-4cdb-b714-d80e509a3082 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.336319 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5ccad7b7-b40f-4cdb-b714-d80e509a3082 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.356877 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-28bcd006-f29a-46d3-afdc-2475523c9962 req-4c5b1ec0-d42d-4569-96e1-a78e3278c04f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 210 time: 0.1557472 May 26 14:44:48.395343 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5ccad7b7-b40f-4cdb-b714-d80e509a3082 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.400408 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-cf07f3b5-e311-4236-9547-0ad41806c906 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:48.412623 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ccad7b7-b40f-4cdb-b714-d80e509a3082 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e99130fd-d70e-4de2-93c0-f208065b334f,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:48.415617 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5ccad7b7-b40f-4cdb-b714-d80e509a3082 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:48.417595 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5ccad7b7-b40f-4cdb-b714-d80e509a3082 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.418803 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5ccad7b7-b40f-4cdb-b714-d80e509a3082 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/e99130fd-d70e-4de2-93c0-f208065b334f HTTP/1.1" status: 204 len: 168 time: 0.1932108 May 26 14:44:48.438558 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.457213 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Transition to ACTIVE for port object ac07176b-6df8-402b-be15-ef2328d925a9 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:44:48.488046 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.506527 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3c95e790-a146-43de-b884-8d4a8df210d0 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:48.641692 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'Port': ['ID=ac07176b-6df8-402b-be15-ef2328d925a9,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:48.645970 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:48.674784 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Network f37261a9-5fa8-47e1-88e3-772578212058 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:44:48.684227 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:44:48.686740 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:44:48.795550 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:48.796129 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:48.903366 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2650890 May 26 14:44:48.944159 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce7c43-5eac-4349-8fc5-96db98974af2 req-a598bba9-07af-4dc7-8823-900639977df5 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:48.954745 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-63ce7c43-5eac-4349-8fc5-96db98974af2 req-a598bba9-07af-4dc7-8823-900639977df5 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.1521380 May 26 14:44:49.015362 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-63ce7c43-5eac-4349-8fc5-96db98974af2 req-3f3a0dc0-0e9e-4aa0-8709-53eb09e221fb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572026 May 26 14:44:49.055571 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 41168) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:49.076407 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:49.096182 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:49.110091 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Usage tracker for resource:security_group_rule and tenant:2d16cb471b844c6aad7da207922dbcee is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:49.133572 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:49.138210 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-aeef4d2e-febe-4b88-bd01-9c52d4762e7c None None] Provisioning for port ac07176b-6df8-402b-be15-ef2328d925a9 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:44:49.145166 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-aeef4d2e-febe-4b88-bd01-9c52d4762e7c None None] Provisioning complete for port ac07176b-6df8-402b-be15-ef2328d925a9 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:44:49.146992 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-aeef4d2e-febe-4b88-bd01-9c52d4762e7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:49.159792 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:49.271324 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-aeef4d2e-febe-4b88-bd01-9c52d4762e7c None None] Port ac07176b-6df8-402b-be15-ef2328d925a9 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:44:49.292533 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:49.297006 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:49.300726 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d97b3916-c164-4e31-a571-3bbf3a1b6e07 req-2b9b0321-8d7d-44cb-a84e-a6527c97a049 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:44:49.302183 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d97b3916-c164-4e31-a571-3bbf3a1b6e07 req-2b9b0321-8d7d-44cb-a84e-a6527c97a049 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1550429 May 26 14:44:49.306554 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fcbdf5dc-574b-445f-85b3-bc354ddb102b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:49.349774 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=2d16cb471b844c6aad7da207922dbcee&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2920599 May 26 14:44:49.351196 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d97b3916-c164-4e31-a571-3bbf3a1b6e07 req-cb1b8855-af3f-4f58-81cd-6ff25adc89b1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427589 May 26 14:44:49.351508 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b514922-a8fa-4d6d-b2b9-62f819413780,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:49.352362 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 41178) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:49.354602 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:49.436062 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0716c87-9a18-4740-ba58-629854d15336 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:49.474704 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0716c87-9a18-4740-ba58-629854d15336 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:49.535908 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0716c87-9a18-4740-ba58-629854d15336 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:49.541751 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9b63b93b-e4f3-43ef-9d62-8717dedbd610 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:49.559721 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0716c87-9a18-4740-ba58-629854d15336 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b514922-a8fa-4d6d-b2b9-62f819413780,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:49.580326 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f0716c87-9a18-4740-ba58-629854d15336 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:49.583746 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f0716c87-9a18-4740-ba58-629854d15336 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:49.585036 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f0716c87-9a18-4740-ba58-629854d15336 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/4b514922-a8fa-4d6d-b2b9-62f819413780 HTTP/1.1" status: 204 len: 168 time: 0.2315838 May 26 14:44:50.213604 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:44:50.923712 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 41230) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:51.060220 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:51.082119 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:44:51.086317 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Usage tracker for resource:security_group_rule and tenant:b0f03d5bc8c44b2b871c7e4eb878f5b0 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:44:51.089408 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:44:51.095142 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:44:51.192469 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:51.197269 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:51.205322 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3201b474-8341-41d9-80ae-306a22076d8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:51.249005 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=b0f03d5bc8c44b2b871c7e4eb878f5b0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3241115 May 26 14:44:51.250036 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=088ce7ed-6b87-4d8b-818c-cf812b4b45b2,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:51.251724 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 41242) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:44:51.253374 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:51.316238 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-076471f3-98fb-4e3c-99b7-4cdc335b9b60 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:51.347559 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-076471f3-98fb-4e3c-99b7-4cdc335b9b60 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:51.406540 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-076471f3-98fb-4e3c-99b7-4cdc335b9b60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:51.410334 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7d91cf0f-8c6f-4d33-8b95-ed073c5d56ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:44:51.425279 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076471f3-98fb-4e3c-99b7-4cdc335b9b60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=088ce7ed-6b87-4d8b-818c-cf812b4b45b2,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:44:51.433872 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-076471f3-98fb-4e3c-99b7-4cdc335b9b60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:44:51.435071 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-076471f3-98fb-4e3c-99b7-4cdc335b9b60 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:51.439106 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-076471f3-98fb-4e3c-99b7-4cdc335b9b60 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/088ce7ed-6b87-4d8b-818c-cf812b4b45b2 HTTP/1.1" status: 204 len: 168 time: 0.1840551 May 26 14:44:51.623462 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7c59bccd-ae0d-4f99-be05-58bd3f38b61b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:53.269767 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8c0a8436-d9fe-4914-9e38-59208067cb11 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:53.837939 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:54.564274 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:55.892077 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:44:57.457481 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:01.815389 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Request body: {'port': {'device_id': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:01.952027 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:02.209843 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-d2c73b51-e51d-497c-80cd-cceadb21edbe service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2055202 May 26 14:45:02.436092 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-aa07c8ba-c34a-4937-98d4-8547ecff8d3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:02.437644 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-aa07c8ba-c34a-4937-98d4-8547ecff8d3a service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1098 time: 0.1751323 May 26 14:45:02.489628 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe77a67-299b-4555-bdd9-5a297f6b4e48 req-3a29e762-32cc-43c1-bfa0-a7e107a6d174 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:02.490505 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-0fe77a67-299b-4555-bdd9-5a297f6b4e48 req-3a29e762-32cc-43c1-bfa0-a7e107a6d174 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Synchronizing usage tracker for tenant:3defae92a9a1480c9278cae3445f9617 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:45:02.638078 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-0fe77a67-299b-4555-bdd9-5a297f6b4e48 req-3a29e762-32cc-43c1-bfa0-a7e107a6d174 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Unset dirty status for tenant:3defae92a9a1480c9278cae3445f9617 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:45:02.645831 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0fe77a67-299b-4555-bdd9-5a297f6b4e48 req-3a29e762-32cc-43c1-bfa0-a7e107a6d174 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 931 time: 0.6362484 May 26 14:45:02.708425 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-82ae579a-b1d9-4126-9a1f-b79d940259d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:02.708425 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-82ae579a-b1d9-4126-9a1f-b79d940259d0 service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.2393107 May 26 14:45:02.714926 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-0fe77a67-299b-4555-bdd9-5a297f6b4e48 req-906ad504-2231-427c-b062-7482c39bf2c3 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Synchronizing usage tracker for tenant:3defae92a9a1480c9278cae3445f9617 on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:45:02.779414 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-0fe77a67-299b-4555-bdd9-5a297f6b4e48 req-906ad504-2231-427c-b062-7482c39bf2c3 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Unset dirty status for tenant:3defae92a9a1480c9278cae3445f9617 on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:45:02.788048 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0fe77a67-299b-4555-bdd9-5a297f6b4e48 req-906ad504-2231-427c-b062-7482c39bf2c3 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1412840 May 26 14:45:02.800537 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-f67e26fa-b62f-4708-9b4f-2a7a3a8b02f8 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 200 len: 217 time: 0.0878026 May 26 14:45:02.875658 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-78e5250b-b38b-46b2-8ebc-43d721015f40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:02.877190 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-78e5250b-b38b-46b2-8ebc-43d721015f40 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.0677435 May 26 14:45:02.896776 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ac07176b-6df8-402b-be15-ef2328d925a9 {{(pid=98445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:45:02.907135 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:02.931307 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Transition to ACTIVE for port object ac07176b-6df8-402b-be15-ef2328d925a9 will not be triggered until provisioned by entity L2. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:45:02.960821 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-bd73a73e-ffd3-4c8c-bf4e-eb6ecd933eff service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0751395 May 26 14:45:03.064878 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:03.092976 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3d64f57d-e23d-4cbf-b5b6-d795f2ad44f6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:03.140654 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-671ad01a-5cee-429a-9c2c-c79db43c4595 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1714799 May 26 14:45:03.460152 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Pushing event updated for resources: {'Port': ['ID=ac07176b-6df8-402b-be15-ef2328d925a9,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:03.500790 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.408s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:03.555906 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-e40899a3-2ed6-49eb-9e12-6ac66d9399fb req-dc1496d9-ce4a-4266-b946-05188469ab75 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4059565 May 26 14:45:03.668813 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20b5d259-874f-4665-99ad-e512ebda6e9b req-6c911467-7f38-48f6-a2e2-623c75759fd1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:03.686382 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-20b5d259-874f-4665-99ad-e512ebda6e9b req-6c911467-7f38-48f6-a2e2-623c75759fd1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.7527745 May 26 14:45:03.868921 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-20b5d259-874f-4665-99ad-e512ebda6e9b req-a76688c5-a803-4ee4-8f84-a595f558ffb1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1811612 May 26 14:45:03.909600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Attempting to bind port ac07176b-6df8-402b-be15-ef2328d925a9 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:45:03.910716 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Attempting to bind port ac07176b-6df8-402b-be15-ef2328d925a9 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:45:03.911199 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Attempting to bind port ac07176b-6df8-402b-be15-ef2328d925a9 on network f37261a9-5fa8-47e1-88e3-772578212058 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:45:03.916320 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Port ac07176b-6df8-402b-be15-ef2328d925a9 on network f37261a9-5fa8-47e1-88e3-772578212058 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:45:03.916887 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Attempting to bind port ac07176b-6df8-402b-be15-ef2328d925a9 on network f37261a9-5fa8-47e1-88e3-772578212058 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:45:03.923778 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 44, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:45:03.924441 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Checking segment: {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:45:03.924982 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Bound using segment: {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:45:03.926107 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Bound port: ac07176b-6df8-402b-be15-ef2328d925a9, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '19ef5432-879a-4038-8a6a-666cab9adc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1108, 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058'}}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:45:03.926683 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:03.950578 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-842fd0db-a64d-4c8e-9ba2-385f22ddef88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:03.953961 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-842fd0db-a64d-4c8e-9ba2-385f22ddef88 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1098 time: 0.2710123 May 26 14:45:04.200390 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-047084e9-29ca-4f43-81f4-34aaeb72f96a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:04.203111 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-047084e9-29ca-4f43-81f4-34aaeb72f96a service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.2419944 May 26 14:45:04.324108 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-cbae7442-5ea6-4092-95a5-a197c7c7e825 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 200 len: 217 time: 0.1061800 May 26 14:45:04.442400 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2332825-d915-4422-a58e-f3377fcea150 req-c5351224-3379-4117-ba73-c15db400228b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:04.452114 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c2332825-d915-4422-a58e-f3377fcea150 req-c5351224-3379-4117-ba73-c15db400228b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 943 time: 0.5135601 May 26 14:45:04.475943 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] For port ac07176b-6df8-402b-be15-ef2328d925a9, host hv-cinder-77459, cleared binding levels {{(pid=98445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:45:04.557806 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] For port ac07176b-6df8-402b-be15-ef2328d925a9, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ac07176b-6df8-402b-be15-ef2328d925a9,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:45:04.571718 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-eb42ce51-0b3c-4ca2-8f97-1612a6206fb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:04.573382 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-eb42ce51-0b3c-4ca2-8f97-1612a6206fb5 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.2133958 May 26 14:45:04.574257 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:04.637815 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:04.699648 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-f276bf58-084a-4f0a-ab08-a0317556eff2 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1149247 May 26 14:45:04.816245 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c2332825-d915-4422-a58e-f3377fcea150 req-c6b7ca5d-409b-4165-ab11-67787d3ad424 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3629184 May 26 14:45:04.822963 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Pushing event updated for resources: {'Port': ['ID=ac07176b-6df8-402b-be15-ef2328d925a9,revision_number=3']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:04.835230 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:04.850925 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:04.851992 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:04.853336 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] 10.222.0.79 "PUT /v2.0/ports/ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 1093 time: 3.0428116 May 26 14:45:04.856898 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:45:05.045109 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'status': 'completed', 'code': 200} May 26 14:45:05.175118 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-61edfc76-9982-4e7a-8480-e59d2f7f0431 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:05.178948 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-61edfc76-9982-4e7a-8480-e59d2f7f0431 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3defae92a9a1480c9278cae3445f9617&device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1096 time: 0.2459579 May 26 14:45:05.219886 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-688b032a-1cb1-428b-8810-d0aead52d43b service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5131249 May 26 14:45:05.271483 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-b633d29a-d536-42f2-a907-6aad9de07587 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 217 time: 0.0765889 May 26 14:45:05.347953 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b8055d-8eb2-40c6-b204-862fcef0ece9 req-a994edf2-77a0-4ae0-a8d1-d443a4b5dd02 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:05.349288 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-25b8055d-8eb2-40c6-b204-862fcef0ece9 req-a994edf2-77a0-4ae0-a8d1-d443a4b5dd02 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.2463925 May 26 14:45:05.350852 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-8bf893e9-17e7-4fa4-8d69-4ee893272328 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:05.352146 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-8bf893e9-17e7-4fa4-8d69-4ee893272328 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=466228a3-069c-4ecc-9790-37e83a8604c9 HTTP/1.1" status: 200 len: 854 time: 0.0724990 May 26 14:45:05.366663 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e6f9391-3401-454c-9c17-6a433c4316ce req-14506150-9240-45f7-89de-93d6f8ac8d11 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1378655 May 26 14:45:05.453072 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-25b8055d-8eb2-40c6-b204-862fcef0ece9 req-88b00507-84ef-4f28-803c-d23395e479b2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967758 May 26 14:45:05.474703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-9dcd2505-ac0a-4d6a-8635-332cc3490a10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:05.476316 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-9dcd2505-ac0a-4d6a-8635-332cc3490a10 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=f37261a9-5fa8-47e1-88e3-772578212058&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1046863 May 26 14:45:05.647200 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-bd51d785-478b-497f-acfd-5eed633774e8 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1451442 May 26 14:45:05.795012 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa022787-505a-4f31-8033-8ae8b04c5e95 req-428bc3d1-2d04-472b-99c5-cb60e7bfd72d service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1399183 May 26 14:45:06.184733 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-dade9c22-3347-42e1-8e2e-2350ef9afd04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:06.196840 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-dade9c22-3347-42e1-8e2e-2350ef9afd04 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3defae92a9a1480c9278cae3445f9617&device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1096 time: 0.2528417 May 26 14:45:06.253628 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6081c7a9-8cde-46d1-a8ef-477950012f67 req-eb08d581-5322-49cd-81cb-a2c2601bb542 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:06.255221 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6081c7a9-8cde-46d1-a8ef-477950012f67 req-eb08d581-5322-49cd-81cb-a2c2601bb542 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 943 time: 0.2598565 May 26 14:45:06.389585 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-e9bfba39-c4b0-4575-82e9-7f96005859f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:06.391007 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-e9bfba39-c4b0-4575-82e9-7f96005859f5 service neutron] 10.222.0.79 "GET /v2.0/networks?id=f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 200 len: 917 time: 0.1933324 May 26 14:45:06.492435 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-c5820268-da29-40da-8827-fe74ed3ba809 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 217 time: 0.0915279 May 26 14:45:06.502792 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6081c7a9-8cde-46d1-a8ef-477950012f67 req-f0cf5c51-f3c1-466d-9721-5232ae12d8fc tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1328592 May 26 14:45:06.603877 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-ee2e3dd4-9317-4fc4-a89a-0993057e3b69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:06.610510 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-ee2e3dd4-9317-4fc4-a89a-0993057e3b69 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=466228a3-069c-4ecc-9790-37e83a8604c9 HTTP/1.1" status: 200 len: 854 time: 0.0953491 May 26 14:45:06.715439 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-d6600368-e481-4c54-b2ec-eb74a2993b1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:06.718936 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-d6600368-e481-4c54-b2ec-eb74a2993b1f service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=f37261a9-5fa8-47e1-88e3-772578212058&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0945604 May 26 14:45:06.878029 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-2aae0da2-49f3-44a5-90a9-899adf447ef1 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1502421 May 26 14:45:07.031573 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ac92f107-3d22-4f98-8d83-a660f4025c90 req-3996bb25-e9b5-4423-bfa1-a70246f8e905 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1464887 May 26 14:45:07.456867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7998a5a7-3645-4fb0-ac13-1813a3215ff6 req-0b0616b2-9e62-487b-9525-0ec746af06c3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:07.458894 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7998a5a7-3645-4fb0-ac13-1813a3215ff6 req-0b0616b2-9e62-487b-9525-0ec746af06c3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.2051332 May 26 14:45:07.509167 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7998a5a7-3645-4fb0-ac13-1813a3215ff6 req-8c699139-e249-487f-9311-9dd1d93f3987 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442643 May 26 14:45:07.715735 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b19baf3d-92d2-4417-84fa-8530f8fd8aab req-909cd562-27c8-415b-8b91-0629e1d7d7a1 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:07.717288 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b19baf3d-92d2-4417-84fa-8530f8fd8aab req-909cd562-27c8-415b-8b91-0629e1d7d7a1 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 943 time: 0.0948987 May 26 14:45:07.773116 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b19baf3d-92d2-4417-84fa-8530f8fd8aab req-2e79e321-7cc5-4bfd-9155-694640f73c8c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497336 May 26 14:45:10.664801 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device ac07176b-6df8-402b-be15-ef2328d925a9 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:45:10.815850 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port ac07176b-6df8-402b-be15-ef2328d925a9, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ac07176b-6df8-402b-be15-ef2328d925a9,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:10.832115 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'port_id': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'mac_address': 'fa:16:3e:6a:09:71', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:45:10.891835 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:10.914039 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ac07176b-6df8-402b-be15-ef2328d925a9 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:45:10.931341 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port ac07176b-6df8-402b-be15-ef2328d925a9, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ac07176b-6df8-402b-be15-ef2328d925a9,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:10.937248 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:10.939247 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:11.012781 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=ac07176b-6df8-402b-be15-ef2328d925a9,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:11.020646 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.021224 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.021787 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.021894 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.022220 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.022766 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.023361 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.023629 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.023994 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.024335 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.024662 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.025012 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:11.036474 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:11.440514 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ac07176b-6df8-402b-be15-ef2328d925a9'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:45:13.583734 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device ac07176b-6df8-402b-be15-ef2328d925a9 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:45:13.666107 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port ac07176b-6df8-402b-be15-ef2328d925a9 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:45:13.672589 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port ac07176b-6df8-402b-be15-ef2328d925a9 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:45:13.673006 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:13.804277 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:13.833960 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:45:13.844943 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port ac07176b-6df8-402b-be15-ef2328d925a9, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ac07176b-6df8-402b-be15-ef2328d925a9,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:13.849403 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:13.851806 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:13.936462 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=ac07176b-6df8-402b-be15-ef2328d925a9,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:13.939738 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:17.954009 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 41642) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:18.109518 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:18.133478 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:18.137951 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Usage tracker for resource:security_group_rule and tenant:93ff95cb455743edb92b7ab4f51d63e7 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:18.141765 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:18.154534 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:18.248600 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:18.254753 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:18.263830 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-92cd9669-e98f-4c75-b070-9613c53cf021 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:18.305767 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=93ff95cb455743edb92b7ab4f51d63e7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3506987 May 26 14:45:18.306796 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69f563eb-6542-4aaf-9a35-5162af1bb158,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:18.308729 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 41654) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:18.311499 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:18.380833 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-accd4eb5-9d35-4a6e-912a-fcde36113c22 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:18.409602 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-accd4eb5-9d35-4a6e-912a-fcde36113c22 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:18.485836 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-accd4eb5-9d35-4a6e-912a-fcde36113c22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:18.495103 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5d8b8e30-92e6-4179-9231-f1a881987541 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:18.508313 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-accd4eb5-9d35-4a6e-912a-fcde36113c22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69f563eb-6542-4aaf-9a35-5162af1bb158,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:18.517943 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-accd4eb5-9d35-4a6e-912a-fcde36113c22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:18.518848 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-accd4eb5-9d35-4a6e-912a-fcde36113c22 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:18.520163 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-accd4eb5-9d35-4a6e-912a-fcde36113c22 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/69f563eb-6542-4aaf-9a35-5162af1bb158 HTTP/1.1" status: 204 len: 168 time: 0.2096703 May 26 14:45:19.949719 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-1a9ad5c6-a18b-450f-81e6-1a4be000966c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:19.951213 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-1a9ad5c6-a18b-450f-81e6-1a4be000966c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 813 time: 0.1805260 May 26 14:45:19.968048 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-b44f569f-1659-4940-9187-1579c26d181d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/quotas/3159eb22d2eb468e967fa04761ae0331 HTTP/1.1" status: 200 len: 375 time: 0.0094786 May 26 14:45:20.059896 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-816b3246-ab6e-4977-8ee9-650dfe1d590b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0871093 May 26 14:45:20.241516 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-79b589b8-3cf6-4a9e-a454-9bfeb346ed6d service neutron] 10.222.0.72 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1500676 May 26 14:45:20.249915 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-414b9905-9865-4c11-917b-6c38a862a435 req-1e8f6899-c96b-4067-a9c4-fcf6d339433f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:20.251324 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-414b9905-9865-4c11-917b-6c38a862a435 req-1e8f6899-c96b-4067-a9c4-fcf6d339433f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1905499 May 26 14:45:20.374736 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-414b9905-9865-4c11-917b-6c38a862a435 req-a01e6d5e-cdda-4fde-9924-1f8b96d6804c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1052437 May 26 14:45:20.408461 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-35621996-3ea8-45e6-868f-3e3668d2588d service neutron] 10.222.0.72 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1562240 May 26 14:45:20.549030 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'code': 200} May 26 14:45:20.567064 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592aa273-88f0-4c24-9797-365eb5a61467 req-c4c39dfe-6e3e-42f3-960f-7c4fc7be247f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:20.568548 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-592aa273-88f0-4c24-9797-365eb5a61467 req-c4c39dfe-6e3e-42f3-960f-7c4fc7be247f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0960095 May 26 14:45:20.644633 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-592aa273-88f0-4c24-9797-365eb5a61467 req-7a95e969-3151-4371-9578-b8b027846d97 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698407 May 26 14:45:20.936277 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d821bb3-0be5-4908-b22d-4f9f561daedb req-2315871f-7d71-4e37-8c5d-5046b5ccb918 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 210 time: 0.1165512 May 26 14:45:20.998144 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7288414f-7590-40f9-ab54-5791c8121b73 req-584149bd-e9cd-4f94-9425-c1e0176d048b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:21.001144 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7288414f-7590-40f9-ab54-5791c8121b73 req-584149bd-e9cd-4f94-9425-c1e0176d048b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.2268503 May 26 14:45:21.030376 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633a9432-d856-4f1b-ae6a-296001fe5204 req-2759c35c-65b7-4d61-9410-f24b01e8eced service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:21.032423 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-633a9432-d856-4f1b-ae6a-296001fe5204 req-2759c35c-65b7-4d61-9410-f24b01e8eced service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1098 time: 0.1687496 May 26 14:45:21.077005 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7288414f-7590-40f9-ab54-5791c8121b73 req-804bb422-ffd7-47c3-aab2-4393dc1dc843 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0658629 May 26 14:45:21.185452 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-633a9432-d856-4f1b-ae6a-296001fe5204 req-96a7f632-f86b-4b42-bc69-ac96e3768bff service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996327 May 26 14:45:21.234929 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfde5eb-a9ae-432c-8489-11b421934f80 req-e39f3530-b481-4f66-8bfd-d359ddc4f729 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:21.236434 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bcfde5eb-a9ae-432c-8489-11b421934f80 req-e39f3530-b481-4f66-8bfd-d359ddc4f729 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1021166 May 26 14:45:21.300171 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bcfde5eb-a9ae-432c-8489-11b421934f80 req-c82e6e8b-c3c5-4698-81c6-43de94e2ed76 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0572045 May 26 14:45:21.588567 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7993505-5103-4e6b-8ce9-29da28b49dce req-4df5d9db-c456-4592-b385-e6327eef75c4 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:21.590501 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f7993505-5103-4e6b-8ce9-29da28b49dce req-4df5d9db-c456-4592-b385-e6327eef75c4 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0955329 May 26 14:45:21.631883 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e40cb8a3-5f85-489f-be6e-143546ef0a83 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:21.649671 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f7993505-5103-4e6b-8ce9-29da28b49dce req-10e5c155-26ec-4490-9f20-0d094424b899 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529745 May 26 14:45:21.849371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f41f3262-9b4a-472b-8097-f9013f079989 req-a3422ff5-068e-40ba-a8c6-f0abd9a50da6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:21.851098 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f41f3262-9b4a-472b-8097-f9013f079989 req-a3422ff5-068e-40ba-a8c6-f0abd9a50da6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0911624 May 26 14:45:21.916429 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f41f3262-9b4a-472b-8097-f9013f079989 req-89fc1b3e-90ee-4636-b248-d7cadd6e5eb0 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582900 May 26 14:45:22.109227 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6af1421f-f1d7-4980-aff0-62e490da0b45 req-a9e52952-ce8e-4b9f-a5cb-bb98f9bf56f9 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 210 time: 0.0455127 May 26 14:45:22.276393 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d46743-7392-45ce-82c3-7832f1df08df req-73b059a2-dab7-4ad0-9f11-6170f9478e3e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:22.277840 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-58d46743-7392-45ce-82c3-7832f1df08df req-73b059a2-dab7-4ad0-9f11-6170f9478e3e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0827446 May 26 14:45:22.328183 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-58d46743-7392-45ce-82c3-7832f1df08df req-8ce1b4dc-a39f-4f6c-a408-6bdffa0e01d8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412436 May 26 14:45:22.578430 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ab4c26-17ad-48c4-821a-a018b26de709 req-60f9b4d6-77f4-4a66-b69e-437c12afa8d2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:22.580991 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-81ab4c26-17ad-48c4-821a-a018b26de709 req-60f9b4d6-77f4-4a66-b69e-437c12afa8d2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1793330 May 26 14:45:22.630287 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-81ab4c26-17ad-48c4-821a-a018b26de709 req-9db90f99-41bd-4f59-ba9e-f95c9d767a9d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418377 May 26 14:45:22.935482 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-fdc8f9e8-002a-4656-8cd4-07fd8aa75bd8 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:22.936914 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-fdc8f9e8-002a-4656-8cd4-07fd8aa75bd8 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 813 time: 0.2133660 May 26 14:45:22.939926 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 41822) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:22.988148 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082c70e4-9ac7-4679-b991-af60f8131b1c req-cddff3df-a63e-4900-b7d7-be0fa8ec3d33 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:22.989719 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-082c70e4-9ac7-4679-b991-af60f8131b1c req-cddff3df-a63e-4900-b7d7-be0fa8ec3d33 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1858115 May 26 14:45:23.002482 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Request body: {'port': {'device_id': 'ff7e548f-59bc-43b2-8eff-666dd795446a', 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'admin_state_up': True, 'tenant_id': '3159eb22d2eb468e967fa04761ae0331'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:23.162918 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Deleting subnet 12c3a6cc-90f7-4a24-9389-58ed3aa06051 {{(pid=98445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:45:23.190455 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:23.258902 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-082c70e4-9ac7-4679-b991-af60f8131b1c req-4c32e77f-507d-4b3e-8f46-cf236210924f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2320538 May 26 14:45:23.272063 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f810b3c4-6f26-41e7-a0ac-50115167feff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:23.289662 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2677826'] for subnet, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:23.373398 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:23.430880 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11435fef-88d8-4257-96e6-fa54dfa4144b req-5049512d-edb6-4ae4-8a30-0d72db3e734f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:23.432264 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-11435fef-88d8-4257-96e6-fa54dfa4144b req-5049512d-edb6-4ae4-8a30-0d72db3e734f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.3247051 May 26 14:45:23.433210 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:23.459029 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:23.477056 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f22dbaa5-c8ed-4fdf-aed9-0617ea4fc3fa req-786dac68-2faa-49a6-b1bc-d8667c611bd6 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 210 time: 0.1057932 May 26 14:45:23.513858 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Made reservation on behalf of 3159eb22d2eb468e967fa04761ae0331 for: {'port': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:45:23.517585 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:23.661684 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-11435fef-88d8-4257-96e6-fa54dfa4144b req-33812221-ded9-4018-a98b-700551c481d3 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1911123 May 26 14:45:23.796592 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:23.994369 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Allocated IP 172.20.0.7 (c6d63b53-7bae-4cfb-ac0b-4643c0894395/e482f08e-dc41-4d58-b9cf-6de9798b0585/a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:45:24.017068 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3462df60-b11e-4493-b723-e412bbf88e51 req-66b4ca08-1f19-4607-90d2-1d012cdfa143 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:24.018599 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3462df60-b11e-4493-b723-e412bbf88e51 req-66b4ca08-1f19-4607-90d2-1d012cdfa143 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.4009359 May 26 14:45:24.107542 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bbf8599-5595-48cf-bb53-96bdf94c82c8 req-dfb31b7d-a942-40f7-9d66-3dcbfc3072f6 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:24.109055 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9bbf8599-5595-48cf-bb53-96bdf94c82c8 req-dfb31b7d-a942-40f7-9d66-3dcbfc3072f6 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.3490777 May 26 14:45:24.122621 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2332920', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2577448'] for subnet, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.152127 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-88540956-1b89-4d08-89b9-c94eaa222f1e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:24.204055 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3462df60-b11e-4493-b723-e412bbf88e51 req-f486cf4d-b903-43b2-8a29-d09a23f6f553 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1761928 May 26 14:45:24.219600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=12c3a6cc-90f7-4a24-9389-58ed3aa06051,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:24.265818 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:24.283672 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.460930 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9bbf8599-5595-48cf-bb53-96bdf94c82c8 req-b6605c81-acfc-43c1-9478-bafdd778e3a4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3422890 May 26 14:45:24.481784 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] 10.222.0.72 "DELETE /v2.0/subnets/12c3a6cc-90f7-4a24-9389-58ed3aa06051 HTTP/1.1" status: 204 len: 168 time: 1.5408611 May 26 14:45:24.484738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 41856) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:24.532967 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.556797 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.570330 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe8e09f-30ff-473d-ac4f-62f071073ed7 req-4d80d873-4c4d-45ab-84ad-c274e5bcd485 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:24.571995 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cbe8e09f-30ff-473d-ac4f-62f071073ed7 req-4d80d873-4c4d-45ab-84ad-c274e5bcd485 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1732578 May 26 14:45:24.629693 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cbe8e09f-30ff-473d-ac4f-62f071073ed7 req-b8ce4fa4-2985-4525-96ba-80b8ec04397d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475731 May 26 14:45:24.631053 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.635541 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.640148 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:24.692426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ec4ee3ea-9d36-4c14-a225-a3445629295c', 'c15a8128-db77-479e-9b42-25276139f049', '6edfff02-2e00-4da7-8c08-37a887f1f08f'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:45:24.776175 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Network c6d63b53-7bae-4cfb-ac0b-4643c0894395 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:45:24.783128 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:45:24.787258 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Pushing event updated for resources: {'Port': ['ID=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:24.790632 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:45:24.797021 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.811227 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ed7a1e1a-7ae1-41d4-a402-addaf23d4837']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:45:24.823776 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd3f9151f-5909-4b72-bd16-08d37a5eb84a') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:45:24.824523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd3f9151f-5909-4b72-bd16-08d37a5eb84a') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:45:24.836606 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.846790 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:24.855426 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.865030 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Releasing vlan 1115 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:45:24.865333 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:45:24.879907 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:45:24.913170 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bce1c9b7-7646-48dc-9826-5f1271328652 req-4b796a23-8a48-4775-a8e7-ab55590dee88 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:24.913870 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-bce1c9b7-7646-48dc-9826-5f1271328652 req-4b796a23-8a48-4775-a8e7-ab55590dee88 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Synchronizing usage tracker for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:45:24.923820 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:24.924427 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.963662 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9707429 May 26 14:45:24.965113 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-bce1c9b7-7646-48dc-9826-5f1271328652 req-4b796a23-8a48-4775-a8e7-ab55590dee88 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Unset dirty status for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:45:24.969990 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bce1c9b7-7646-48dc-9826-5f1271328652 req-4b796a23-8a48-4775-a8e7-ab55590dee88 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 931 time: 0.3332698 May 26 14:45:24.970198 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.972967 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:24.984538 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ed1cee-bcae-489d-838b-af3e95484da9 req-fbd11e76-0b85-4a0f-9b25-cabd67dee24f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:24.986081 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66ed1cee-bcae-489d-838b-af3e95484da9 req-fbd11e76-0b85-4a0f-9b25-cabd67dee24f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.2006869 May 26 14:45:24.991243 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:24.997942 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Pushing event deleted for resources: {'Network': ['ID=ed7a1e1a-7ae1-41d4-a402-addaf23d4837,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:25.002584 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:25.017089 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-4f40714b-a533-4e9e-b902-ddfed146dc01 admin admin] 10.222.0.72 "DELETE /v2.0/networks/ed7a1e1a-7ae1-41d4-a402-addaf23d4837 HTTP/1.1" status: 204 len: 168 time: 0.5307584 May 26 14:45:25.031424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Request body: {'port': {'device_id': 'ff7e548f-59bc-43b2-8eff-666dd795446a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:25.115224 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-66ed1cee-bcae-489d-838b-af3e95484da9 req-10fd6e00-47d0-4771-9d65-d1aef6323922 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1121631 May 26 14:45:25.127180 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bce1c9b7-7646-48dc-9826-5f1271328652 req-600d3a9d-561c-4cb2-8385-34800c8007cc tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1512976 May 26 14:45:25.201501 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:25.305539 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 41874) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:25.355661 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f95acf17-5c41-4ba3-9adf-85e915cff491 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=1a5c67cf2b5f455180b60afe8233d534&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0488710 May 26 14:45:25.358113 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 41878) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:25.421746 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9424d442-bd07-41a5-9d98-ee5c9025c5e4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:25.448483 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9424d442-bd07-41a5-9d98-ee5c9025c5e4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:25.505669 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9424d442-bd07-41a5-9d98-ee5c9025c5e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:25.510751 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5ccad7b7-b40f-4cdb-b714-d80e509a3082 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:25.523041 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9424d442-bd07-41a5-9d98-ee5c9025c5e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=deb69b02-d196-40d2-94bd-23224ce4150e,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:25.527702 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9424d442-bd07-41a5-9d98-ee5c9025c5e4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:25.531164 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9424d442-bd07-41a5-9d98-ee5c9025c5e4 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/deb69b02-d196-40d2-94bd-23224ce4150e HTTP/1.1" status: 204 len: 168 time: 0.1696894 May 26 14:45:25.531164 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9424d442-bd07-41a5-9d98-ee5c9025c5e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:25.588142 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-923d47e1-a5e7-4bb9-b1a0-59eab3a69386 req-c606e0b0-c374-43fa-a1b9-9e3758d4e24e tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:25.589628 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-923d47e1-a5e7-4bb9-b1a0-59eab3a69386 req-c606e0b0-c374-43fa-a1b9-9e3758d4e24e tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.3155987 May 26 14:45:25.640703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bf551d-d830-4396-a2bb-2f72f95dba5a req-aa37c17f-f2cd-436d-93d3-cbde7f99925f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:25.642188 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-74bf551d-d830-4396-a2bb-2f72f95dba5a req-aa37c17f-f2cd-436d-93d3-cbde7f99925f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.2951837 May 26 14:45:25.711454 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-923d47e1-a5e7-4bb9-b1a0-59eab3a69386 req-08157803-8eaf-434a-838b-af73c7ca44ea tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1135070 May 26 14:45:25.736366 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-74bf551d-d830-4396-a2bb-2f72f95dba5a req-f56fb061-b949-44d9-9aa1-51e0536bc1d4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0840926 May 26 14:45:25.885951 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:25.973214 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 {{(pid=98445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:45:26.000069 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:26.029565 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Transition to ACTIVE for port object a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 will not be triggered until provisioned by entity L2. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:45:26.039193 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:26.048017 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:26.169057 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661596df-16d0-400c-b8d6-3301722a2908 req-66cf97f1-ca09-4f12-b522-0453462a77ba tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:26.176451 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-661596df-16d0-400c-b8d6-3301722a2908 req-66cf97f1-ca09-4f12-b522-0453462a77ba tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.3100173 May 26 14:45:26.222056 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e728d31-b5f7-4f0b-b432-795473c37000 req-7f6f11ae-61f8-44fc-902b-e4266b1dc64d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:26.223619 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0e728d31-b5f7-4f0b-b432-795473c37000 req-7f6f11ae-61f8-44fc-902b-e4266b1dc64d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.3106391 May 26 14:45:26.355744 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Pushing event updated for resources: {'Port': ['ID=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:26.369522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:26.495835 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-661596df-16d0-400c-b8d6-3301722a2908 req-053292b5-772b-454f-8613-11f0eaf9e879 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3184023 May 26 14:45:26.500686 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0e728d31-b5f7-4f0b-b432-795473c37000 req-66545017-a127-450e-9aa8-85841cbc5635 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2526476 May 26 14:45:26.550337 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Attempting to bind port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:45:26.550744 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Attempting to bind port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:45:26.551055 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Attempting to bind port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:45:26.564821 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:45:26.565565 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Attempting to bind port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 on network c6d63b53-7bae-4cfb-ac0b-4643c0894395 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:45:26.571846 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 45, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:45:26.572188 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Checking segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:45:26.572905 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Bound using segment: {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:45:26.573328 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Bound port: a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '663227a3-9a48-4112-a25f-e542d7087a84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395'}}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:45:26.573680 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:26.742104 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] For port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286, host hv-cinder-77459, cleared binding levels {{(pid=98445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:45:26.746448 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] For port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:45:26.755422 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:26.759663 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:26.822393 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffe0b50-bcc0-4aac-9204-2976f04f8bd2 req-b4b66934-9266-44d0-87ab-c9d503b9b47b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:26.823920 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8ffe0b50-bcc0-4aac-9204-2976f04f8bd2 req-b4b66934-9266-44d0-87ab-c9d503b9b47b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 943 time: 0.1945238 May 26 14:45:26.832438 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:26.833039 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:26.834751 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] 10.222.0.79 "PUT /v2.0/ports/a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 HTTP/1.1" status: 200 len: 1093 time: 1.8358867 May 26 14:45:26.838607 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff7e548f-59bc-43b2-8eff-666dd795446a', 'tag': 'a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:45:27.001545 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Pushing event updated for resources: {'Port': ['ID=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,revision_number=3']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:27.005422 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.246s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:27.009742 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8ffe0b50-bcc0-4aac-9204-2976f04f8bd2 req-24e9e516-e813-47f9-8ce2-5654b92111de tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1740713 May 26 14:45:27.050788 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-e43f4a29-f6c7-46cf-b182-8c63ddd1f949 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:27.052360 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-e43f4a29-f6c7-46cf-b182-8c63ddd1f949 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 1096 time: 0.1358783 May 26 14:45:27.061495 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87953714-30a5-46d4-804e-2369ae1fdedf req-d411abe8-2886-49b5-a4b9-ffc0d84a8753 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:27.062911 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-87953714-30a5-46d4-804e-2369ae1fdedf req-d411abe8-2886-49b5-a4b9-ffc0d84a8753 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.2197676 May 26 14:45:27.193684 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-4c6406ce-0799-4c19-9b91-de93f5bd0da5 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 HTTP/1.1" status: 200 len: 217 time: 0.1062384 May 26 14:45:27.218266 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:45:27.281444 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-87953714-30a5-46d4-804e-2369ae1fdedf req-47dcb175-ec0d-4f15-9727-17879bb02315 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2115314 May 26 14:45:27.337723 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-cee032f8-63ed-4a8f-bb59-fabb039107fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:27.339230 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-cee032f8-63ed-4a8f-bb59-fabb039107fa service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.1293354 May 26 14:45:27.357118 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b01f3c2-4bce-46cf-b635-a2ead76d5a47 req-e8e2bc70-0e91-411b-8e00-05da1abb1b90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:27.358734 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2b01f3c2-4bce-46cf-b635-a2ead76d5a47 req-e8e2bc70-0e91-411b-8e00-05da1abb1b90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.2166903 May 26 14:45:27.360446 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff7e548f-59bc-43b2-8eff-666dd795446a', 'tag': 'a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286', 'status': 'completed', 'code': 200} May 26 14:45:27.439288 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-c8a11a3e-795f-4606-b54e-d71f9a02520d service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0907114 May 26 14:45:27.454889 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2b01f3c2-4bce-46cf-b635-a2ead76d5a47 req-8f6930c4-db25-451c-a917-80d23f75aaab tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0637970 May 26 14:45:27.463084 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:27.626800 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-2dd77c78-bb04-4061-a395-c2e623d0cd32 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1704404 May 26 14:45:28.011980 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef9fb31-1950-4dfd-9c5b-b4e4a8288b98 req-24898b90-a621-44f3-aea5-c3f582a3ecd1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:28.013611 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4ef9fb31-1950-4dfd-9c5b-b4e4a8288b98 req-24898b90-a621-44f3-aea5-c3f582a3ecd1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.3485081 May 26 14:45:28.015405 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52ec2c7c-f2d9-4bfe-8c7d-55ed1c54c00e req-58a6e442-7891-40b5-bf38-d67cc61d4a52 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3828053 May 26 14:45:28.023150 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e563ef-20bb-4c3e-9aac-aadad624a9b6 req-3800f294-a22f-45a7-b3f5-63ad6e58dbad tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:28.024591 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-22e563ef-20bb-4c3e-9aac-aadad624a9b6 req-3800f294-a22f-45a7-b3f5-63ad6e58dbad tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.3606937 May 26 14:45:28.094790 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4ef9fb31-1950-4dfd-9c5b-b4e4a8288b98 req-e9971080-e8cc-4ab1-a0f3-a18708e4a093 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0691218 May 26 14:45:28.099191 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-22e563ef-20bb-4c3e-9aac-aadad624a9b6 req-6468a8b5-1d66-41a5-90dc-e4f0c076f92a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601373 May 26 14:45:28.277399 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27615a0-ce34-4706-8e04-05b411ece427 req-5c4b68de-5d6b-4f1d-8d1b-95820a632d7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:28.278929 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d27615a0-ce34-4706-8e04-05b411ece427 req-5c4b68de-5d6b-4f1d-8d1b-95820a632d7b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3159eb22d2eb468e967fa04761ae0331&device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 1096 time: 0.1348662 May 26 14:45:28.294581 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2535309d-5821-4a53-ac6b-eb5646f5405f req-51759934-c97a-4f8c-a6e2-7ad4b7d60f0f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:28.295978 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2535309d-5821-4a53-ac6b-eb5646f5405f req-51759934-c97a-4f8c-a6e2-7ad4b7d60f0f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 943 time: 0.0963714 May 26 14:45:28.419755 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2535309d-5821-4a53-ac6b-eb5646f5405f req-103b7545-4f93-42fd-83c5-14fd46f5a38d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1055501 May 26 14:45:28.453469 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27615a0-ce34-4706-8e04-05b411ece427 req-19a81e7c-c977-4aea-8aa7-3ac708693446 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:28.454939 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d27615a0-ce34-4706-8e04-05b411ece427 req-19a81e7c-c977-4aea-8aa7-3ac708693446 service neutron] 10.222.0.79 "GET /v2.0/networks?id=c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 200 len: 915 time: 0.1580696 May 26 14:45:28.653544 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d27615a0-ce34-4706-8e04-05b411ece427 req-e36eadfc-17db-4b50-b22b-b7d4d5f7b270 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 HTTP/1.1" status: 200 len: 217 time: 0.1893861 May 26 14:45:28.742880 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7654e3-d0ff-4260-806d-71ce98936c54 req-538ca5e6-2f3f-47f0-82fe-d4f2ef98063d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:28.744291 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bf7654e3-d0ff-4260-806d-71ce98936c54 req-538ca5e6-2f3f-47f0-82fe-d4f2ef98063d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1334796 May 26 14:45:28.747653 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27615a0-ce34-4706-8e04-05b411ece427 req-e254a6f0-fc9d-4c14-bd7d-9ba5093b4e4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:28.748930 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d27615a0-ce34-4706-8e04-05b411ece427 req-e254a6f0-fc9d-4c14-bd7d-9ba5093b4e4b service neutron] 10.222.0.79 "GET /v2.0/subnets?id=e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 200 len: 853 time: 0.0714755 May 26 14:45:28.808488 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d27615a0-ce34-4706-8e04-05b411ece427 req-8f8430f4-159d-4284-85af-ccafd2c5acfd service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=c6d63b53-7bae-4cfb-ac0b-4643c0894395&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0455108 May 26 14:45:28.829081 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bf7654e3-d0ff-4260-806d-71ce98936c54 req-2650709c-e12d-4cdd-a5d8-52588cd3719d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0788047 May 26 14:45:28.966192 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d27615a0-ce34-4706-8e04-05b411ece427 req-88724fd6-deb6-4975-944e-14d272292385 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1402435 May 26 14:45:29.123852 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d27615a0-ce34-4706-8e04-05b411ece427 req-63cbc976-447e-4bfd-ad6a-5d4ea3c94111 service neutron] 10.222.0.79 "GET /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1497240 May 26 14:45:29.358679 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41a13f82-1e60-4d00-99f1-80ac5c50b734 req-c90091e2-006f-443b-be2f-7b3970eb48aa tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:29.360221 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-41a13f82-1e60-4d00-99f1-80ac5c50b734 req-c90091e2-006f-443b-be2f-7b3970eb48aa tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1506634 May 26 14:45:29.370165 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce08c70c-22c7-442c-866a-a5d026e79711 req-b19e695c-9dab-43fc-861b-e5f10cd7736a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:29.371523 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ce08c70c-22c7-442c-866a-a5d026e79711 req-b19e695c-9dab-43fc-861b-e5f10cd7736a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1309838 May 26 14:45:29.443032 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-41a13f82-1e60-4d00-99f1-80ac5c50b734 req-1373d00d-acbf-4cee-8305-cf97e0b3272a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0703616 May 26 14:45:29.447952 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ce08c70c-22c7-442c-866a-a5d026e79711 req-4f22a1c0-bea9-486e-ad0f-de51c1825c55 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617797 May 26 14:45:29.631271 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052efe83-e55b-44e0-bc41-40260cab7086 req-9d3fbae5-8668-40ec-a393-8d54fcaf8ff6 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:29.633196 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-052efe83-e55b-44e0-bc41-40260cab7086 req-9d3fbae5-8668-40ec-a393-8d54fcaf8ff6 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 943 time: 0.0854943 May 26 14:45:29.679737 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-052efe83-e55b-44e0-bc41-40260cab7086 req-df4c3f7f-2c27-43b6-bd0c-d7ee1b41a882 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403059 May 26 14:45:30.035948 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da0f0dac-2abc-4fc0-a138-6ea97b8142cf req-db290db3-41b8-475d-920d-18bb9c6d9aec tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:30.037498 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-da0f0dac-2abc-4fc0-a138-6ea97b8142cf req-db290db3-41b8-475d-920d-18bb9c6d9aec tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0859723 May 26 14:45:30.086613 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-da0f0dac-2abc-4fc0-a138-6ea97b8142cf req-50def446-3526-4124-8c79-7ee18dffda31 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423303 May 26 14:45:30.646807 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c5a3a0-411e-4d59-9c56-4da82aa6dbce req-a15d253b-635e-4ab2-afdb-81be80f60af1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:30.648311 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c9c5a3a0-411e-4d59-9c56-4da82aa6dbce req-a15d253b-635e-4ab2-afdb-81be80f60af1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0869668 May 26 14:45:30.696492 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c9c5a3a0-411e-4d59-9c56-4da82aa6dbce req-f8648445-f0bf-4a0f-9f6c-32b7a0bcbe05 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417957 May 26 14:45:30.875407 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4ae0a3-238a-4030-933a-0432b733264f req-6bab6d6c-10b5-4893-84d7-624765221cb8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:30.876913 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3a4ae0a3-238a-4030-933a-0432b733264f req-6bab6d6c-10b5-4893-84d7-624765221cb8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0817642 May 26 14:45:30.928890 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3a4ae0a3-238a-4030-933a-0432b733264f req-cc58c17c-49b0-4eb1-acd8-2d2619cf7480 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450199 May 26 14:45:31.112982 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfbe99a0-c2ac-4d36-a1ab-6801d76e52ad req-fc3e45fe-a791-487d-aa14-6904be85b9b2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:31.115165 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cfbe99a0-c2ac-4d36-a1ab-6801d76e52ad req-fc3e45fe-a791-487d-aa14-6904be85b9b2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 943 time: 0.0874002 May 26 14:45:31.161775 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cfbe99a0-c2ac-4d36-a1ab-6801d76e52ad req-f4af7222-1f67-4616-bb79-1b6c06547231 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409765 May 26 14:45:31.349652 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b3cc10-1e44-4238-96d7-7e7d3eb5c8d9 req-5c12237f-0394-45d6-962b-f57d1b31f406 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:31.351185 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-85b3cc10-1e44-4238-96d7-7e7d3eb5c8d9 req-5c12237f-0394-45d6-962b-f57d1b31f406 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0927098 May 26 14:45:31.397363 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-85b3cc10-1e44-4238-96d7-7e7d3eb5c8d9 req-cdcc1449-93d7-4ea3-9f1d-f26923cf1c52 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402999 May 26 14:45:31.899618 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99271e6-7737-44f1-bd13-0d14d95e7269 req-d729b5cb-0ce2-4bd4-a21f-83918adb80ef tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:31.901128 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e99271e6-7737-44f1-bd13-0d14d95e7269 req-d729b5cb-0ce2-4bd4-a21f-83918adb80ef tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0960310 May 26 14:45:31.949163 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e99271e6-7737-44f1-bd13-0d14d95e7269 req-ab5363bc-aa0c-4634-bf92-dbdcf0d55b02 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392683 May 26 14:45:32.145841 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d9ad86-0a25-4ebd-9adc-479c0caaef5e req-1e0d261a-3210-4f36-ba1a-1e6381c1c953 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:32.147507 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06d9ad86-0a25-4ebd-9adc-479c0caaef5e req-1e0d261a-3210-4f36-ba1a-1e6381c1c953 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0908675 May 26 14:45:32.200276 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06d9ad86-0a25-4ebd-9adc-479c0caaef5e req-ca580508-5550-4d43-a9a4-bde62bb38724 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465424 May 26 14:45:32.387483 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73713530-03d8-4dfd-bbba-849771925645 req-8af29234-528c-42ab-b7a4-75d40c7935ac tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:32.389047 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-73713530-03d8-4dfd-bbba-849771925645 req-8af29234-528c-42ab-b7a4-75d40c7935ac tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 943 time: 0.0821118 May 26 14:45:32.422906 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:45:32.439785 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-73713530-03d8-4dfd-bbba-849771925645 req-4efaf84b-643a-4565-97e1-a39743ae0a84 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429528 May 26 14:45:32.579823 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:32.595431 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': 'a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286', 'network_id': 'c6d63b53-7bae-4cfb-ac0b-4643c0894395', 'port_id': 'a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286', 'mac_address': 'fa:16:3e:bf:bd:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e482f08e-dc41-4d58-b9cf-6de9798b0585', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:45:32.663144 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:32.680708 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:45:32.697780 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:32.703470 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:32.705870 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:32.751655 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f96fa2-3993-4663-8117-a0fabc0e82ef req-e691ff7c-bfe2-403a-9aef-e82a0f92e971 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:32.761468 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b4f96fa2-3993-4663-8117-a0fabc0e82ef req-e691ff7c-bfe2-403a-9aef-e82a0f92e971 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.2238147 May 26 14:45:32.779483 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:32.790754 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:32.815571 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b4f96fa2-3993-4663-8117-a0fabc0e82ef req-304a051c-26ed-47db-933b-6a2a193478c2 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0531061 May 26 14:45:33.168873 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e7dc24-c468-4faa-8378-d19947c6eb56 req-50e31d03-3a9c-4e21-92a2-e2ca2cf98e5f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:33.170290 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-09e7dc24-c468-4faa-8378-d19947c6eb56 req-50e31d03-3a9c-4e21-92a2-e2ca2cf98e5f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0841107 May 26 14:45:33.217352 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-09e7dc24-c468-4faa-8378-d19947c6eb56 req-3656b056-5e4b-4586-a8e0-021436c1c7b0 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385642 May 26 14:45:33.268869 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:45:33.398506 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b10b8dbd-b43d-43ea-bee0-338a375b5558 req-73fc2e7d-548f-44dc-89eb-ad6a6d0842d1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:33.400105 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b10b8dbd-b43d-43ea-bee0-338a375b5558 req-73fc2e7d-548f-44dc-89eb-ad6a6d0842d1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0842812 May 26 14:45:33.449083 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b10b8dbd-b43d-43ea-bee0-338a375b5558 req-e397c423-6048-4e20-a2db-d7c73192773a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425415 May 26 14:45:33.633627 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc104668-6a6f-4ffc-8970-de0af536176c req-c707949b-3428-4c89-83cd-74ef927e5824 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:33.635122 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bc104668-6a6f-4ffc-8970-de0af536176c req-c707949b-3428-4c89-83cd-74ef927e5824 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 944 time: 0.0891993 May 26 14:45:33.682082 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bc104668-6a6f-4ffc-8970-de0af536176c req-4b7e1701-acca-439b-b63e-b5a29910a9e9 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385914 May 26 14:45:34.012138 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8becf8-353f-41c0-8105-9f2c69ce0956 req-03d9997b-45dc-45e6-aeff-34d1a5f6a61c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:34.013627 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6f8becf8-353f-41c0-8105-9f2c69ce0956 req-03d9997b-45dc-45e6-aeff-34d1a5f6a61c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0822017 May 26 14:45:34.060385 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6f8becf8-353f-41c0-8105-9f2c69ce0956 req-8ef0f0bb-d375-4bdd-91f4-abecee9f58a2 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407019 May 26 14:45:34.413719 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d449160c-1b7e-464a-94f3-ed6c0798523f req-9ac83777-6663-47bd-b858-3426b39fd6cb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:34.414995 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d449160c-1b7e-464a-94f3-ed6c0798523f req-9ac83777-6663-47bd-b858-3426b39fd6cb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0878232 May 26 14:45:34.462035 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d449160c-1b7e-464a-94f3-ed6c0798523f req-f50374f0-41bc-439f-ab79-6b11e0eba71f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412560 May 26 14:45:34.646068 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918787cb-51fe-476e-a38f-11ef4c23fa15 req-4e72c294-ef92-48c1-8311-517809ccbd61 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:34.647612 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-918787cb-51fe-476e-a38f-11ef4c23fa15 req-4e72c294-ef92-48c1-8311-517809ccbd61 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0846789 May 26 14:45:34.696849 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-918787cb-51fe-476e-a38f-11ef4c23fa15 req-0a3bee3a-b9c5-452c-ab59-b9131648f18e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434284 May 26 14:45:34.876291 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533878e2-6abf-4d5e-aeac-5ed86f72f219 req-cec797b1-8b74-4a9a-abac-321d9fde7e8f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:34.877879 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-533878e2-6abf-4d5e-aeac-5ed86f72f219 req-cec797b1-8b74-4a9a-abac-321d9fde7e8f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 944 time: 0.0836420 May 26 14:45:34.926171 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-533878e2-6abf-4d5e-aeac-5ed86f72f219 req-323228b7-31f6-46b3-bc5a-2a4f6bbaceca tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421498 May 26 14:45:35.283971 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a179c3-82ef-43e0-a003-48ac51966b97 req-065c9525-8706-47a9-994b-f10a558641e9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:35.285602 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-47a179c3-82ef-43e0-a003-48ac51966b97 req-065c9525-8706-47a9-994b-f10a558641e9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1056554 May 26 14:45:35.334959 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-47a179c3-82ef-43e0-a003-48ac51966b97 req-65926faf-f608-4a6a-b9ca-c711fb2a0cbe tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418777 May 26 14:45:35.656668 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0dc631a-f836-45c5-aa8f-9cf47c28affc req-ef346432-2d24-4ba1-93e6-4b2b62f95ed8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:35.658135 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b0dc631a-f836-45c5-aa8f-9cf47c28affc req-ef346432-2d24-4ba1-93e6-4b2b62f95ed8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0903850 May 26 14:45:35.703721 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b0dc631a-f836-45c5-aa8f-9cf47c28affc req-9dcb264d-bb30-4719-8b04-4988e3859a61 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396419 May 26 14:45:35.897326 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983269df-cf3b-4583-afa1-8ca8b8048732 req-ec6e8538-a624-40c6-a53c-cfc375f81b26 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:35.898835 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-983269df-cf3b-4583-afa1-8ca8b8048732 req-ec6e8538-a624-40c6-a53c-cfc375f81b26 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0899704 May 26 14:45:35.944354 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-983269df-cf3b-4583-afa1-8ca8b8048732 req-bd28d461-e0b0-4fb7-9955-aa4815e6914a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395482 May 26 14:45:36.131310 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f883a1b-09af-492c-ba83-57ab8d32317d req-056d5bd1-6131-49a3-9584-c77c84e923b8 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:36.132886 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5f883a1b-09af-492c-ba83-57ab8d32317d req-056d5bd1-6131-49a3-9584-c77c84e923b8 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 944 time: 0.0976026 May 26 14:45:36.182394 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5f883a1b-09af-492c-ba83-57ab8d32317d req-bb5c92c7-5009-4936-aefe-d03f3c984520 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438390 May 26 14:45:36.476966 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:45:36.540314 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daeebbd7-7c7c-4fd3-bb1d-4c44565bc372 req-d1c1d92c-97db-4284-958f-13cb46e89ec0 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:36.541838 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-daeebbd7-7c7c-4fd3-bb1d-4c44565bc372 req-d1c1d92c-97db-4284-958f-13cb46e89ec0 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0870109 May 26 14:45:36.552443 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:45:36.558593 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:45:36.559035 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:36.588931 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-daeebbd7-7c7c-4fd3-bb1d-4c44565bc372 req-271c84c0-4488-4556-969d-079eeb7ceef1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404887 May 26 14:45:36.689702 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:36.719222 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff7e548f-59bc-43b2-8eff-666dd795446a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:45:36.731270 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:36.738361 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:36.741769 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:36.775564 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff7e548f-59bc-43b2-8eff-666dd795446a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286', 'code': 200} May 26 14:45:36.816206 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:36.819599 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:36.903772 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed538a4-4cd3-40f6-a7c2-82f76f31bc5a req-9361ff1a-41d4-4a6d-ae89-294c7d101ae1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:36.905232 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aed538a4-4cd3-40f6-a7c2-82f76f31bc5a req-9361ff1a-41d4-4a6d-ae89-294c7d101ae1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0859611 May 26 14:45:36.953709 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aed538a4-4cd3-40f6-a7c2-82f76f31bc5a req-08112c72-e856-46fb-a261-ce2040afc6aa tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423734 May 26 14:45:37.065334 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1de717b-6302-440b-81ff-76020c42e815 req-29e22230-32f7-42dc-8f3e-b23519a4f483 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:37.066829 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f1de717b-6302-440b-81ff-76020c42e815 req-29e22230-32f7-42dc-8f3e-b23519a4f483 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 1098 time: 0.0727966 May 26 14:45:37.170296 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f1de717b-6302-440b-81ff-76020c42e815 req-9f0e5d09-d995-4122-824b-e01819b63f9a service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662589 May 26 14:45:37.196343 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5daf237b-fe46-479e-878c-3fb713689942 req-947e4d88-9a88-4784-821e-c6622aa020fa tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:37.198916 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5daf237b-fe46-479e-878c-3fb713689942 req-947e4d88-9a88-4784-821e-c6622aa020fa tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1266532 May 26 14:45:37.260138 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5daf237b-fe46-479e-878c-3fb713689942 req-13d9105c-2921-4907-b2be-4ddcb5bcf647 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558202 May 26 14:45:37.386281 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565da017-45a4-428e-b83a-f36da746542f req-7d56a762-bbb6-4055-ae1b-a1a49a49569d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:37.387807 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-565da017-45a4-428e-b83a-f36da746542f req-7d56a762-bbb6-4055-ae1b-a1a49a49569d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 945 time: 0.0803478 May 26 14:45:37.435530 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-565da017-45a4-428e-b83a-f36da746542f req-3f3e6682-2ed7-4b23-b886-0d9996b301a3 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421095 May 26 14:45:37.616231 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 42188) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:37.790376 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71fb848-05c3-469a-bc22-e018c62d465f req-a59465f7-d96b-43ce-bc59-316bb768432a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:37.791970 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c71fb848-05c3-469a-bc22-e018c62d465f req-a59465f7-d96b-43ce-bc59-316bb768432a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0833220 May 26 14:45:37.820486 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:37.849100 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:37.856978 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Usage tracker for resource:security_group_rule and tenant:0daef8d8bf3242399ff8663057e4b979 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:37.861372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:37.870545 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c71fb848-05c3-469a-bc22-e018c62d465f req-7625e1a4-79a9-4d1f-a02f-8a8aa72cdbf1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0652943 May 26 14:45:37.871372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:38.052089 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:38.057322 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:38.065371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ad0e5480-f3bf-48a5-8a5c-f2ae4e8f844b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:38.146283 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=0daef8d8bf3242399ff8663057e4b979&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5288000 May 26 14:45:38.148045 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19562f46-bb22-44de-a9ee-0acf1f9ea7be,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:38.149196 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 42204) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:38.156119 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:38.195042 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec190087-a033-4337-aaba-026ab24334fb req-a603a9ac-5618-4fa6-9aab-3947c0e2038d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:38.196530 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ec190087-a033-4337-aaba-026ab24334fb req-a603a9ac-5618-4fa6-9aab-3947c0e2038d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1321793 May 26 14:45:38.213928 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a483d0f4-210a-4301-95db-24de32e9e104 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:38.240433 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a483d0f4-210a-4301-95db-24de32e9e104 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:38.247035 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ec190087-a033-4337-aaba-026ab24334fb req-0070f483-eafc-4643-bdd4-ba15e06497d2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444407 May 26 14:45:38.303492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a483d0f4-210a-4301-95db-24de32e9e104 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:38.310438 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-076471f3-98fb-4e3c-99b7-4cdc335b9b60 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:38.330715 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a483d0f4-210a-4301-95db-24de32e9e104 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19562f46-bb22-44de-a9ee-0acf1f9ea7be,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:38.343744 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a483d0f4-210a-4301-95db-24de32e9e104 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:38.345101 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a483d0f4-210a-4301-95db-24de32e9e104 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:38.346490 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a483d0f4-210a-4301-95db-24de32e9e104 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/19562f46-bb22-44de-a9ee-0acf1f9ea7be HTTP/1.1" status: 204 len: 168 time: 0.1963382 May 26 14:45:38.488340 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff468e24-4ef4-4eef-bdaa-ed61c485b5ec req-53ad8de1-6501-4b8b-8a5e-868a5906c781 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:38.489997 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ff468e24-4ef4-4eef-bdaa-ed61c485b5ec req-53ad8de1-6501-4b8b-8a5e-868a5906c781 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0974004 May 26 14:45:38.547246 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ff468e24-4ef4-4eef-bdaa-ed61c485b5ec req-983eaf10-a3e5-4ea8-905b-2dab668e26fd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492547 May 26 14:45:38.641926 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391c9553-855c-4bc5-a69a-d05bdc8dd744 req-80abff6c-2204-4302-a401-9759ee5449f5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:38.643451 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-391c9553-855c-4bc5-a69a-d05bdc8dd744 req-80abff6c-2204-4302-a401-9759ee5449f5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 945 time: 0.0855026 May 26 14:45:38.689548 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-391c9553-855c-4bc5-a69a-d05bdc8dd744 req-6abac87e-8f4e-49eb-af15-8f43f9d0654b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402322 May 26 14:45:39.089761 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89c6f8a1-c768-418d-9829-95eea3ad71b1 req-722400a0-14e5-4f15-8fe9-5fda1b91eeda tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:39.092006 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-89c6f8a1-c768-418d-9829-95eea3ad71b1 req-722400a0-14e5-4f15-8fe9-5fda1b91eeda tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0980918 May 26 14:45:39.139856 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-89c6f8a1-c768-418d-9829-95eea3ad71b1 req-9ba2e2ef-4146-4467-944b-1c2a72c52af3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421357 May 26 14:45:39.482471 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64457134-9e6f-4bd0-96d9-ce21ef7fe22c req-3b13680d-f586-4958-aa1e-c26b34bf447c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:39.483986 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-64457134-9e6f-4bd0-96d9-ce21ef7fe22c req-3b13680d-f586-4958-aa1e-c26b34bf447c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0980203 May 26 14:45:39.531384 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-64457134-9e6f-4bd0-96d9-ce21ef7fe22c req-a23f364e-9d69-4535-8229-dea0587626be tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417302 May 26 14:45:39.802170 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7117241-0930-4e88-9b00-2457f9868a1b req-876e5433-b7fa-4295-9fe1-bb183a27cd27 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:39.815379 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c7117241-0930-4e88-9b00-2457f9868a1b req-876e5433-b7fa-4295-9fe1-bb183a27cd27 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1605070 May 26 14:45:39.945162 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c7117241-0930-4e88-9b00-2457f9868a1b req-3bfdfe71-c53b-4080-be02-fd8783970594 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1121724 May 26 14:45:39.989914 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26f891fe-226c-44f9-8f7a-13f1f190a17a req-16151d39-e114-4902-85e7-f9ac7bc6c379 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:39.991536 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26f891fe-226c-44f9-8f7a-13f1f190a17a req-16151d39-e114-4902-85e7-f9ac7bc6c379 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 945 time: 0.1006455 May 26 14:45:40.038478 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26f891fe-226c-44f9-8f7a-13f1f190a17a req-36a60e48-3eec-48b3-a37a-200ebb31a7d9 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406597 May 26 14:45:40.341859 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c00db49e-1681-48fd-b382-ef802f3b2db0 req-1d5a9922-1659-4fa2-bef9-4dc5e9e34822 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:40.343505 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c00db49e-1681-48fd-b382-ef802f3b2db0 req-1d5a9922-1659-4fa2-bef9-4dc5e9e34822 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0874367 May 26 14:45:40.403246 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c00db49e-1681-48fd-b382-ef802f3b2db0 req-adaacd24-6027-4c20-a8dd-084126cd1dca tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0536213 May 26 14:45:40.735703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a6f6fc-125d-47b1-8e16-369a7b1aaccb req-4b309534-7f39-469b-adbd-a7626e8beda1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:40.737252 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-55a6f6fc-125d-47b1-8e16-369a7b1aaccb req-4b309534-7f39-469b-adbd-a7626e8beda1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0914273 May 26 14:45:40.787017 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-55a6f6fc-125d-47b1-8e16-369a7b1aaccb req-e375fd82-0e7a-4e0b-b815-3bfae8af4712 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427034 May 26 14:45:41.176386 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8cf69c8-2ebe-49d3-a931-e601bc9101b0 req-2648151e-b405-4bd3-9d1e-0c733bca3d15 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:41.177860 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d8cf69c8-2ebe-49d3-a931-e601bc9101b0 req-2648151e-b405-4bd3-9d1e-0c733bca3d15 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0920672 May 26 14:45:41.222974 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d8cf69c8-2ebe-49d3-a931-e601bc9101b0 req-5b78355c-8a34-4d7d-b82b-ef8da8bc6a02 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393403 May 26 14:45:41.406272 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c94fc4e1-ec29-484c-8dac-57bed86efb60 req-58d7150f-0a45-491e-9ef0-e857585c3ebf tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:41.407888 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c94fc4e1-ec29-484c-8dac-57bed86efb60 req-58d7150f-0a45-491e-9ef0-e857585c3ebf tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0894330 May 26 14:45:41.455543 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c94fc4e1-ec29-484c-8dac-57bed86efb60 req-aedbc06c-b20c-43b5-9f14-56d8c5cf348d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413010 May 26 14:45:41.479742 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 42356) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:41.640131 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6826e2b7-e5da-4b21-8419-06395f2a577b req-0f750038-d5ae-4500-a588-823de584c584 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:41.641624 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6826e2b7-e5da-4b21-8419-06395f2a577b req-0f750038-d5ae-4500-a588-823de584c584 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0845969 May 26 14:45:41.741205 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6826e2b7-e5da-4b21-8419-06395f2a577b req-064f889a-e83a-46a6-a04d-373df3c429f9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0936022 May 26 14:45:41.757352 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78a40742-0fbe-4d65-932d-22a0d06007a2 tempest-TestMinimumBasicScenario-2122895312 tempest-TestMinimumBasicScenario-2122895312-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:41.758292 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-78a40742-0fbe-4d65-932d-22a0d06007a2 tempest-TestMinimumBasicScenario-2122895312 tempest-TestMinimumBasicScenario-2122895312-project-admin] Synchronizing usage tracker for tenant:91aab1b1c8f643b5a396e20256a142c6 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:45:41.779922 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-78a40742-0fbe-4d65-932d-22a0d06007a2 tempest-TestMinimumBasicScenario-2122895312 tempest-TestMinimumBasicScenario-2122895312-project-admin] Unset dirty status for tenant:91aab1b1c8f643b5a396e20256a142c6 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:45:41.781193 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-78a40742-0fbe-4d65-932d-22a0d06007a2 tempest-TestMinimumBasicScenario-2122895312 tempest-TestMinimumBasicScenario-2122895312-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1093 time: 0.3003922 May 26 14:45:41.784543 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 42366) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:41.789935 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'port_id': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'fixed_ip_address': '172.20.0.9'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:41.796453 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:41.801012 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:floatingip and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:41.804607 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:41.814544 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:41.825193 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for floatingip, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:41.965715 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:42.137919 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Allocated IP 172.27.3.108 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/9a71da7e-bd23-4f38-95b4-89d8516732e5) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:45:42.294169 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:42.324972 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:42.328944 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1c9512ea-9d38-47d8-8957-709449d5f0f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:42.405628 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:45:42.407007 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abbd6e7a-7fe3-4eb5-b20a-0d0553cfb879 req-0e29d8ed-3022-4499-8d08-ac53c501f2cf tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:42.408907 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-abbd6e7a-7fe3-4eb5-b20a-0d0553cfb879 req-0e29d8ed-3022-4499-8d08-ac53c501f2cf tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0935392 May 26 14:45:42.410122 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:45:42.414956 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:45:42.442756 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'Port': ['ID=9a71da7e-bd23-4f38-95b4-89d8516732e5,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:42.450251 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:42.458932 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-abbd6e7a-7fe3-4eb5-b20a-0d0553cfb879 req-c1caf826-0e2e-460d-ac72-5328f1a0e7f4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438092 May 26 14:45:42.657186 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d039ea1f-4a42-42ac-afbe-39ac65b5228f req-78f5f206-2121-4320-93b3-00df02c97b23 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:42.658630 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d039ea1f-4a42-42ac-afbe-39ac65b5228f req-78f5f206-2121-4320-93b3-00df02c97b23 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0874479 May 26 14:45:42.703725 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d039ea1f-4a42-42ac-afbe-39ac65b5228f req-492a40a9-6e12-44e2-a3f1-7e0dae5d5bcd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389411 May 26 14:45:42.936952 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92f8789-bac3-4252-b706-c319040ed13b req-c967ff0f-6aa8-402d-94ec-889e9a9d70d9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:42.938380 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c92f8789-bac3-4252-b706-c319040ed13b req-c967ff0f-6aa8-402d-94ec-889e9a9d70d9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0821733 May 26 14:45:42.987538 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c92f8789-bac3-4252-b706-c319040ed13b req-d88bb518-362b-48bf-a9a3-455cafe9eda8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428112 May 26 14:45:43.045853 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:43.169292 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:43.383295 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:43.389370 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:43.394288 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:43.504498 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'Port': ['ID=9a71da7e-bd23-4f38-95b4-89d8516732e5,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:43.509087 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:43.513747 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:43.657091 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb9f18b0-770d-4560-9afc-cb69edbbf294 req-f1e10f8a-ff6a-4b29-80d8-954ee752160f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:43.660087 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb9f18b0-770d-4560-9afc-cb69edbbf294 req-f1e10f8a-ff6a-4b29-80d8-954ee752160f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0936375 May 26 14:45:43.691153 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Floating IP 06e9f647-add0-41cb-bb0f-18fb54b727f7 associated. External IP: 172.27.3.108, port: ac07176b-6df8-402b-be15-ef2328d925a9. May 26 14:45:43.708406 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb9f18b0-770d-4560-9afc-cb69edbbf294 req-aad1f1c1-7921-4751-b8e5-8cef3058f46f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417850 May 26 14:45:43.900362 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5096369e-1337-4ac6-9c49-413aeb46092e req-7d091c0f-47e8-4e8b-9558-167c06a57574 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:43.901881 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5096369e-1337-4ac6-9c49-413aeb46092e req-7d091c0f-47e8-4e8b-9558-167c06a57574 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0866082 May 26 14:45:43.949048 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5096369e-1337-4ac6-9c49-413aeb46092e req-3d859f2e-cbe6-4c35-bcf7-7e4f27047ffd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411429 May 26 14:45:44.151241 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Router 7cd46f66-75af-44f8-b523-9201f57ddbda has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:45:44.281347 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-081c30f9-1e78-484d-966a-10549a3ad71b req-34780cac-3db9-41e2-9889-310b97888f4d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:44.288403 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-081c30f9-1e78-484d-966a-10549a3ad71b req-34780cac-3db9-41e2-9889-310b97888f4d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1815848 May 26 14:45:44.334109 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-081c30f9-1e78-484d-966a-10549a3ad71b req-d1f6575d-d5fa-4132-a3ab-e1727f2d6440 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448649 May 26 14:45:44.349792 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:45:44.365469 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] Sync routers for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:45:44.375847 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:45:44.376464 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:45:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:45:44.383638 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.440874 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.6549165 May 26 14:45:44.441642 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:45:44.443826 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 42408) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:44.449860 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1257580482', 'description': 'tempest-secgroup-smoke-1257580482 description', 'project_id': '3defae92a9a1480c9278cae3445f9617'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:44.459786 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:44.482191 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:44.502294 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.512710 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'status': 'completed', 'code': 200} May 26 14:45:44.524101 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:44.529489 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:security_group_rule and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:44.533107 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:44.539351 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:44.577795 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:45:44.662812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.671038 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.675879 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9fd365ca-3ea8-417b-b66b-07d8251fb5a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:44.729162 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:44.736030 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:44.739597 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79969823-85c0-487a-be60-95110f0fe305 req-a26407d5-ab69-4f8c-acc1-0eefeb46256c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:44.741178 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79969823-85c0-487a-be60-95110f0fe305 req-a26407d5-ab69-4f8c-acc1-0eefeb46256c service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3defae92a9a1480c9278cae3445f9617&device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1098 time: 0.1594284 May 26 14:45:44.744554 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.746750 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3016667 May 26 14:45:44.748763 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 42416) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:44.754173 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'security_group_rule': {'security_group_id': 'f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9', 'project_id': '3defae92a9a1480c9278cae3445f9617', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:44.766356 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:44.778094 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:security_group_rule and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:44.781221 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:44.791462 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:44.811856 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.894785 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.901394 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.904566 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:44.920582 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1f55f372-c911-43bb-993a-1543424f69f0,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:44.930045 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:44.943424 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:44.947385 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1949661 May 26 14:45:44.947546 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79969823-85c0-487a-be60-95110f0fe305 req-0b9d6b21-64e0-4f0f-82f5-e8c1d28a6613 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:44.947546 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79969823-85c0-487a-be60-95110f0fe305 req-0b9d6b21-64e0-4f0f-82f5-e8c1d28a6613 service neutron] 10.222.0.79 "GET /v2.0/networks?id=f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 200 len: 917 time: 0.1978974 May 26 14:45:44.947703 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 42420) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:44.953174 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'security_group_rule': {'security_group_id': 'f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9', 'project_id': '3defae92a9a1480c9278cae3445f9617', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:44.959555 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:44.963551 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:security_group_rule and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:44.966498 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:44.972227 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:44.991438 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.022809 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '06e9f647-add0-41cb-bb0f-18fb54b727f7', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'floating_ip_address': '172.27.3.108', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'port_id': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 338, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'mac_address': 'fa:16:3e:6a:09:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:45:42Z', 'updated_at': '2021-05-26T14:45:42Z', 'revision_number': 0, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:22Z', 'revision_number': 5, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:45:45.027167 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] Checking router: 7cd46f66-75af-44f8-b523-9201f57ddbda for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:45:45.036970 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:45:45.037854 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:45:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:45:45.040941 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e1ab22-ac35-4f81-800b-7980e331f6c3 req-c5d0ddd0-48cb-4ce2-b0e0-fb779901da45 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:45.042435 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-85e1ab22-ac35-4f81-800b-7980e331f6c3 req-c5d0ddd0-48cb-4ce2-b0e0-fb779901da45 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1980162 May 26 14:45:45.066490 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.071308 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.074340 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6c34e3c8-630e-45e2-908c-92f3fe357a34 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:45.097526 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4c8aeff-7e4e-44a1-bae8-4abfae219875,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:45.099312 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79969823-85c0-487a-be60-95110f0fe305 req-95ace08c-f12e-4e62-b779-0513d8e690bd service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 999 time: 0.1429925 May 26 14:45:45.100727 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:45.113426 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-85e1ab22-ac35-4f81-800b-7980e331f6c3 req-5ec1233f-541d-40ce-b03c-7b925af854ee tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580683 May 26 14:45:45.125151 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.132015 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1833649 May 26 14:45:45.134620 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 42426) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:45.141599 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'security_group_rule': {'security_group_id': 'f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9', 'project_id': '3defae92a9a1480c9278cae3445f9617', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:45.148430 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:45.153745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:security_group_rule and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:45.160068 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:45.171213 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:45.191744 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79969823-85c0-487a-be60-95110f0fe305 req-bbb7a5f3-4403-4194-8973-3c5546928f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:45.193246 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79969823-85c0-487a-be60-95110f0fe305 req-bbb7a5f3-4403-4194-8973-3c5546928f38 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=466228a3-069c-4ecc-9790-37e83a8604c9 HTTP/1.1" status: 200 len: 854 time: 0.0788498 May 26 14:45:45.194327 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.242054 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:45:45.280438 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.291051 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.300626 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-910f57d3-6598-44ea-a9b4-1c2eac3e2deb tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:45.331639 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=85a08e28-00dc-4e6e-8b9e-f51e89559b41,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:45.341248 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:45.348350 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79969823-85c0-487a-be60-95110f0fe305 req-9e5cd974-265c-4265-9aed-24dae99d6cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:45.349470 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.349864 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79969823-85c0-487a-be60-95110f0fe305 req-9e5cd974-265c-4265-9aed-24dae99d6cc1 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=f37261a9-5fa8-47e1-88e3-772578212058&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1438808 May 26 14:45:45.354336 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 42432) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:45.355147 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2192423 May 26 14:45:45.359780 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'security_group_rule': {'security_group_id': 'f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9', 'project_id': '3defae92a9a1480c9278cae3445f9617', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:45.372605 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-244db04f-f955-4b24-a734-076e9a414b11 req-b737b18d-5e86-4e0f-ade9-0178d86a8dc2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:45.374181 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-244db04f-f955-4b24-a734-076e9a414b11 req-b737b18d-5e86-4e0f-ade9-0178d86a8dc2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1360652 May 26 14:45:45.396575 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:45.408512 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:security_group_rule and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:45.425897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:45.487849 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:45.542998 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-244db04f-f955-4b24-a734-076e9a414b11 req-b10563b6-c920-4d1f-8aad-803002527535 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1410258 May 26 14:45:45.557698 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.604221 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79969823-85c0-487a-be60-95110f0fe305 req-ad31c8f5-ca79-45f3-bc1f-496231e28ee5 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2289975 May 26 14:45:45.631317 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '06e9f647-add0-41cb-bb0f-18fb54b727f7', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'floating_ip_address': '172.27.3.108', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'port_id': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 338, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'mac_address': 'fa:16:3e:6a:09:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:45:42Z', 'updated_at': '2021-05-26T14:45:42Z', 'revision_number': 0, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:22Z', 'revision_number': 5, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:45:45.636665 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-193e4e61-119a-4eb1-bffe-c7ff4a7a7309 None None] The sync data for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi is: [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '06e9f647-add0-41cb-bb0f-18fb54b727f7', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'floating_ip_address': '172.27.3.108', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'port_id': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 338, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'mac_address': 'fa:16:3e:6a:09:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:45:42Z', 'updated_at': '2021-05-26T14:45:42Z', 'revision_number': 0, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:22Z', 'revision_number': 5, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:45:45.827040 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.836278 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.854081 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-de8a2898-5373-44b5-a976-76cf3937f388 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:45.869402 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-79969823-85c0-487a-be60-95110f0fe305 req-1252110e-ee74-4e2f-ac45-b5e3310556ee service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2504275 May 26 14:45:45.876366 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7c6494b-df82-4288-8044-ef65cd519e5c None None] New status for floating IP 06e9f647-add0-41cb-bb0f-18fb54b727f7: ACTIVE {{(pid=98446) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:45:45.884106 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5021efae-6e94-4450-92e6-80af553b167d,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:45.897895 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.898177 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.898619 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.899057 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.899526 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.899794 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.900143 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.903635 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.903635 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.903635 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.903635 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.903635 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:45:45.906257 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:45.907138 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.911115 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5534623 May 26 14:45:45.912310 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 42442) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:45.919468 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'security_group_rule': {'security_group_id': 'f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9', 'project_id': '3defae92a9a1480c9278cae3445f9617', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:45.925303 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:45.926104 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5024d52-0cc9-4a58-9afd-2f10410a6cd0 req-2d8f0c89-527c-4ead-bd5d-0e86e0c511aa tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:45.927873 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a5024d52-0cc9-4a58-9afd-2f10410a6cd0 req-2d8f0c89-527c-4ead-bd5d-0e86e0c511aa tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.2573121 May 26 14:45:45.929461 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:security_group_rule and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:45.932759 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:45.941947 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:45.963382 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.securitygroups_db [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Project 3defae92a9a1480c9278cae3445f9617 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 26 14:45:45.969122 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:45.990802 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a5024d52-0cc9-4a58-9afd-2f10410a6cd0 req-d3f518aa-30e0-4d92-a547-4a137ebcf182 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0555298 May 26 14:45:46.036155 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:46.040596 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:46.046786 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:46.068362 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=27b831aa-4cdc-42f8-9e2f-e35e10f16157,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:46.070899 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:46.078873 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:46.080390 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1665502 May 26 14:45:46.083149 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 42446) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:45:46.088845 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'security_group_rule': {'security_group_id': 'f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9', 'project_id': '3defae92a9a1480c9278cae3445f9617', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:46.095592 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:46.099354 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Usage tracker for resource:security_group_rule and tenant:3defae92a9a1480c9278cae3445f9617 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:46.102560 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:46.110477 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:46.121650 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.securitygroups_db [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Project 3defae92a9a1480c9278cae3445f9617 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 26 14:45:46.129062 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:46.201093 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:46.209802 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:46.212053 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-60ec3dd8-0dbf-4170-8e84-6dce0c096cfa tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:46.233207 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=17dc630a-0a9c-4c23-bf10-376384560ac8,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:46.237738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:46.246509 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:46.247697 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1636422 May 26 14:45:46.316943 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cab4b4c-14d5-4d73-b655-1d65753faf5f req-0663f5bc-b1f8-4d00-9cce-6ca4fa1692d3 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:46.318516 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9cab4b4c-14d5-4d73-b655-1d65753faf5f req-0663f5bc-b1f8-4d00-9cce-6ca4fa1692d3 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0875807 May 26 14:45:46.365438 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9cab4b4c-14d5-4d73-b655-1d65753faf5f req-0aa7b08b-336c-48df-b673-1d4e4f5c3834 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409667 May 26 14:45:46.505546 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-b020b098-f397-47e8-b9d7-bcf5cac93d46 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Synchronizing usage tracker for tenant:3defae92a9a1480c9278cae3445f9617 on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:45:46.523087 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-b020b098-f397-47e8-b9d7-bcf5cac93d46 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Unset dirty status for tenant:3defae92a9a1480c9278cae3445f9617 on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:45:46.524271 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-b020b098-f397-47e8-b9d7-bcf5cac93d46 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1257580482&fields=id&tenant_id=3defae92a9a1480c9278cae3445f9617 HTTP/1.1" status: 200 len: 267 time: 0.0634410 May 26 14:45:46.617636 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-46f1f5b3-7e97-4394-a6b3-70d1155d9da0 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:46.619018 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-46f1f5b3-7e97-4394-a6b3-70d1155d9da0 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0891380 May 26 14:45:46.629842 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'port': {'security_groups': ['11048e68-75a2-4529-93aa-c6555fbd1fe1', 'f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9']}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:46.749445 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:47.110722 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] For port ac07176b-6df8-402b-be15-ef2328d925a9, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ac07176b-6df8-402b-be15-ef2328d925a9,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:47.143628 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:47.151368 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:47.156982 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:47.207587 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ac07176b-6df8-402b-be15-ef2328d925a9'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:45:47.227136 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:47.227781 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:47.229119 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e798f7bc-9715-4d1d-9aed-5cf707f56969 req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "PUT /v2.0/ports/ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 981 time: 0.6037753 May 26 14:45:47.229631 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:45:47.255531 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'Port': ['ID=ac07176b-6df8-402b-be15-ef2328d925a9,revision_number=6']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:47.259029 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-feab83db-c13c-44b9-aa66-5e073a152834 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:47.425966 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ab6b2b-43a4-472f-83c7-bec58b650486 req-79551b34-cffb-42cf-a129-7e5e8061b01c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:47.431213 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-34ab6b2b-43a4-472f-83c7-bec58b650486 req-79551b34-cffb-42cf-a129-7e5e8061b01c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0985625 May 26 14:45:47.471144 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-ef6a7dda-76f7-4544-96b3-c4952f6cb2f6 None None] Provisioning complete for port ac07176b-6df8-402b-be15-ef2328d925a9 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:45:47.471758 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ef6a7dda-76f7-4544-96b3-c4952f6cb2f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:47.476163 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-34ab6b2b-43a4-472f-83c7-bec58b650486 req-6002bc9e-602c-4a6e-a6a4-bc7f49337cd2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427806 May 26 14:45:47.645314 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ac07176b-6df8-402b-be15-ef2328d925a9'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:45:47.676316 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2210733-dd6b-4d4c-8746-8d9a2cbafce7 req-f3166fcb-9e2e-4bdb-a608-76f8a6ea3edb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:47.678997 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d2210733-dd6b-4d4c-8746-8d9a2cbafce7 req-f3166fcb-9e2e-4bdb-a608-76f8a6ea3edb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0943656 May 26 14:45:47.724758 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d2210733-dd6b-4d4c-8746-8d9a2cbafce7 req-467f5f94-50b3-42a8-a812-e70401a67ba0 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409498 May 26 14:45:47.925621 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d032ec-d374-471b-9bae-5a0878a1f43a req-ff2cca06-e92d-4fa2-a978-8dacc4423504 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:47.928904 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-46d032ec-d374-471b-9bae-5a0878a1f43a req-ff2cca06-e92d-4fa2-a978-8dacc4423504 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.1007094 May 26 14:45:47.976832 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-46d032ec-d374-471b-9bae-5a0878a1f43a req-41190ce6-d751-4d4c-8676-87e3526091be tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0426042 May 26 14:45:48.031832 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'status': 'completed', 'code': 200} May 26 14:45:48.235424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-56978d26-7d34-4efb-a404-5bc873016501 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:48.236842 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-56978d26-7d34-4efb-a404-5bc873016501 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3defae92a9a1480c9278cae3445f9617&device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1137 time: 0.1380711 May 26 14:45:48.248378 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f3c84d-451a-4c05-9922-6188c058806b req-4286b915-69a6-421e-96be-7c36c02b6a05 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:48.249823 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-63f3c84d-451a-4c05-9922-6188c058806b req-4286b915-69a6-421e-96be-7c36c02b6a05 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1120055 May 26 14:45:48.380736 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-63f3c84d-451a-4c05-9922-6188c058806b req-62c35fd4-cee5-49c6-9b7d-f270dca0041e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1076012 May 26 14:45:48.414954 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-9cada277-7339-4971-ae19-4f81529d5ff4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:48.416642 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-9cada277-7339-4971-ae19-4f81529d5ff4 service neutron] 10.222.0.79 "GET /v2.0/networks?id=f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 200 len: 917 time: 0.1659522 May 26 14:45:48.536047 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-0447dd7c-1648-4bb6-a133-aea08772401e service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 1001 time: 0.1047637 May 26 14:45:48.645307 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-04ccfbcf-c65d-47e8-b4c3-88bad5d1603d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:48.646816 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-04ccfbcf-c65d-47e8-b4c3-88bad5d1603d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=466228a3-069c-4ecc-9790-37e83a8604c9 HTTP/1.1" status: 200 len: 854 time: 0.1030765 May 26 14:45:48.737175 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484490b5-fac2-4373-8a70-36635d1d162d req-fbc94f41-2b75-4a06-8e84-4562c46dc200 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:48.738824 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-484490b5-fac2-4373-8a70-36635d1d162d req-fbc94f41-2b75-4a06-8e84-4562c46dc200 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1505320 May 26 14:45:48.772029 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-98e3ddc0-7f33-4231-aa28-3764339c1ba3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:48.773612 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-98e3ddc0-7f33-4231-aa28-3764339c1ba3 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=f37261a9-5fa8-47e1-88e3-772578212058&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1173303 May 26 14:45:48.812301 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-484490b5-fac2-4373-8a70-36635d1d162d req-ffc5e218-4126-4200-8b31-086f215269c2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671735 May 26 14:45:48.959015 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-6a0d71da-b980-479e-9136-b89341c4e186 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1694105 May 26 14:45:49.099792 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2559c9f-9a0a-4da7-920f-9ebd8d11d0b7 req-106d73f1-05a6-43a9-bbd1-a892ecdc7607 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:49.101315 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d2559c9f-9a0a-4da7-920f-9ebd8d11d0b7 req-106d73f1-05a6-43a9-bbd1-a892ecdc7607 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1895375 May 26 14:45:49.224210 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-898ec7a6-60bd-4af7-975a-c0a991f793bc req-a442177d-db4f-4b48-8d1b-17b49e66e971 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2543356 May 26 14:45:49.248849 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d2559c9f-9a0a-4da7-920f-9ebd8d11d0b7 req-9144d8fd-0ff6-4799-9036-b3be4eceae51 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1351113 May 26 14:45:49.598644 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-50ceb347-0191-4cb6-9823-1c6991f176c0 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/networks?tenant_id=8756a7c99bc647a39be9c326450af98a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0312762 May 26 14:45:49.641057 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73fcfe8-8a9b-4ddd-9b4f-abc9c46906bc req-cc391306-52fc-4b61-9183-78c196e53a42 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:49.642646 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f73fcfe8-8a9b-4ddd-9b4f-abc9c46906bc req-cc391306-52fc-4b61-9183-78c196e53a42 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1444111 May 26 14:45:49.777142 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f73fcfe8-8a9b-4ddd-9b4f-abc9c46906bc req-7e0aaa27-6cd1-4575-9a93-e4abb7ef9fad tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1255910 May 26 14:45:49.815546 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-43d2c132-0b90-40c6-be04-845a416a31bc tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:49.817268 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-43d2c132-0b90-40c6-be04-845a416a31bc tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2116504 May 26 14:45:49.833727 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-b280a9b4-1ebd-4f49-986b-9e886f79e28c tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/quotas/8756a7c99bc647a39be9c326450af98a HTTP/1.1" status: 200 len: 375 time: 0.0096672 May 26 14:45:49.888859 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-7ffc6a1a-eb91-4497-aecd-c56c37ad8ed5 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=8756a7c99bc647a39be9c326450af98a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0432527 May 26 14:45:50.022849 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b946f9bd-5fd9-4ed4-96d2-ad5b1721ad96 req-bac2c254-5430-4e1e-aea7-0dab408ba3f2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:50.024446 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b946f9bd-5fd9-4ed4-96d2-ad5b1721ad96 req-bac2c254-5430-4e1e-aea7-0dab408ba3f2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0984514 May 26 14:45:50.083745 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-abae6eb7-404c-4a5c-af11-b861f55a4f9d req-82891c89-bcaf-4547-abba-dad193528602 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 210 time: 0.0578065 May 26 14:45:50.145214 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b946f9bd-5fd9-4ed4-96d2-ad5b1721ad96 req-0dca3f37-d114-43e4-b456-da78489a1c48 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0814812 May 26 14:45:50.477592 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65516400-7727-4a83-9916-5e057e193a09 req-3250c014-a676-440e-a33d-9e3506e90036 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:50.479317 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-65516400-7727-4a83-9916-5e057e193a09 req-3250c014-a676-440e-a33d-9e3506e90036 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0945618 May 26 14:45:50.524428 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-65516400-7727-4a83-9916-5e057e193a09 req-1438ded4-8c76-4aea-8035-598420b17946 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387154 May 26 14:45:50.975888 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1e9803-419a-46f5-9829-b560570dd51a req-4280bc8e-938c-4f38-b56c-60115923cd22 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:50.977347 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4a1e9803-419a-46f5-9829-b560570dd51a req-4280bc8e-938c-4f38-b56c-60115923cd22 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0825784 May 26 14:45:51.024512 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4a1e9803-419a-46f5-9829-b560570dd51a req-9f520100-6f83-4e0f-bb64-2dce82ce3547 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389562 May 26 14:45:51.258896 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d2ed9c0-7513-42ff-bb80-a283d73519d8 req-b55189d9-56c5-4f6b-8ede-af4028e41fea tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 210 time: 0.0546336 May 26 14:45:51.337612 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d72188-f849-492b-8e13-c355c7374816 req-d77d9916-0878-490e-aa0a-cf615ebedcd7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:51.339012 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c3d72188-f849-492b-8e13-c355c7374816 req-d77d9916-0878-490e-aa0a-cf615ebedcd7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0842960 May 26 14:45:51.383272 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c3d72188-f849-492b-8e13-c355c7374816 req-b3dac2ef-ce99-4395-83c6-c7d0a828c83e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385849 May 26 14:45:51.535017 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-0b3899cc-2278-47b8-a2fa-7c5e9fc21a1a tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.79 "GET /v2.0/networks?tenant_id=8756a7c99bc647a39be9c326450af98a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0273912 May 26 14:45:51.648828 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-72e42e80-7d9e-4e30-90df-4e3c6aef70bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:51.775936 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-ed3fca8a-6c6c-44f7-bcb2-486e4ffda35c tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:51.777206 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-ed3fca8a-6c6c-44f7-bcb2-486e4ffda35c tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.79 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2346931 May 26 14:45:51.803537 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26bcebb3-ad72-4fff-a28f-a325992e383f req-ec885568-884e-4fa5-bc75-18945c2f3f42 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:51.804882 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26bcebb3-ad72-4fff-a28f-a325992e383f req-ec885568-884e-4fa5-bc75-18945c2f3f42 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1269162 May 26 14:45:51.833828 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Request body: {'port': {'device_id': 'c6fae069-4b34-4e39-b7d2-d6557ea6519d', 'network_id': '14d03d57-1203-4ea8-864d-d000917df145', 'admin_state_up': True, 'tenant_id': '8756a7c99bc647a39be9c326450af98a'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:51.946434 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26bcebb3-ad72-4fff-a28f-a325992e383f req-069bb5c7-13a2-4cf0-8a64-6c066c18e2e5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1351295 May 26 14:45:52.004045 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:52.008333 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Usage tracker for resource:port and tenant:8756a7c99bc647a39be9c326450af98a is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:52.011219 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:52.017011 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:52.029027 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Made reservation on behalf of 8756a7c99bc647a39be9c326450af98a for: {'port': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:45:52.034000 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:52.049890 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:52.070924 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:45:52.077857 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Usage tracker for resource:security_group_rule and tenant:8756a7c99bc647a39be9c326450af98a is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:45:52.079255 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:45:52.085818 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:45:52.161934 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dc30c9-0865-43ac-a368-d7b533368bf3 req-d9a47957-826c-407a-9bb2-cf231416e8b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:52.163690 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-71dc30c9-0865-43ac-a368-d7b533368bf3 req-d9a47957-826c-407a-9bb2-cf231416e8b8 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1098 time: 0.0912728 May 26 14:45:52.209121 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-71dc30c9-0865-43ac-a368-d7b533368bf3 req-83646fc8-ee7b-4aba-bafc-3ff9f13f671a service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377359 May 26 14:45:52.232870 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:52.239987 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:52.245714 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c0ca39d8-161d-4b7c-8dcb-ad182d9bd81b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:52.336964 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Pushing event updated for resources: {'SecurityGroup': ['ID=471f38f4-1786-4c47-8539-c40e07a726ae,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:52.347806 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:52.453256 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cb0b9855-50c2-47c9-a8c3-6b4e9bbe7073 req-089aab8d-f59e-43f5-ae58-089732baee8e tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 210 time: 0.0837843 May 26 14:45:52.473719 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8531681-c968-45a0-b3a3-553d80139bf4 req-533612e1-5add-4cf6-8488-ca3e8154c708 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:52.475302 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e8531681-c968-45a0-b3a3-553d80139bf4 req-533612e1-5add-4cf6-8488-ca3e8154c708 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.2948880 May 26 14:45:52.504318 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Allocated IP 192.168.233.80 (14d03d57-1203-4ea8-864d-d000917df145/c699aeff-c66c-4ae8-a570-fee2c07c0bd0/07c99fe4-b739-48a8-b269-6578cdfef012) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:45:52.703831 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e8531681-c968-45a0-b3a3-553d80139bf4 req-e745d80a-b141-4c4c-8e26-a193305d5237 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2191789 May 26 14:45:52.844064 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1280ed7e-cb12-490b-9b97-7d1ec1271ad1 req-e5a60ca0-53f2-42df-a5fa-94c64f87a8b5 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:52.845622 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1280ed7e-cb12-490b-9b97-7d1ec1271ad1 req-e5a60ca0-53f2-42df-a5fa-94c64f87a8b5 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.2427504 May 26 14:45:52.920948 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:52.931443 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1280ed7e-cb12-490b-9b97-7d1ec1271ad1 req-f40ed8cf-df8e-41ea-9597-01ccab4bfa45 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786004 May 26 14:45:52.942532 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Transition to ACTIVE for port object 07c99fe4-b739-48a8-b269-6578cdfef012 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:45:52.971633 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:52.977375 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:53.046695 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Network 14d03d57-1203-4ea8-864d-d000917df145 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:45:53.049574 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:45:53.054483 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:45:53.091113 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Pushing event updated for resources: {'Port': ['ID=07c99fe4-b739-48a8-b269-6578cdfef012,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:53.180064 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:53.228097 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:53.233206 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:53.269856 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-11c230e9-89ab-4a78-9b1a-68ee7529c31a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:53.277413 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.4507439 May 26 14:45:53.288527 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34b07c0-0207-4181-8399-530c5d658847 req-ad9be65d-7909-406a-aa0c-f75bcbbb0d28 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:53.294537 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e34b07c0-0207-4181-8399-530c5d658847 req-ad9be65d-7909-406a-aa0c-f75bcbbb0d28 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.2074888 May 26 14:45:53.340238 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e34b07c0-0207-4181-8399-530c5d658847 req-a2d63b67-8b6f-45fd-932e-8c8615084738 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399282 May 26 14:45:53.406201 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-3e53045e-3921-44ae-9ad5-28cfa16b0303 None None] Provisioning for port 07c99fe4-b739-48a8-b269-6578cdfef012 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:45:53.410831 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-3e53045e-3921-44ae-9ad5-28cfa16b0303 None None] Provisioning complete for port 07c99fe4-b739-48a8-b269-6578cdfef012 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:45:53.411248 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3e53045e-3921-44ae-9ad5-28cfa16b0303 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:53.466719 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-3e53045e-3921-44ae-9ad5-28cfa16b0303 None None] Port 07c99fe4-b739-48a8-b269-6578cdfef012 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:45:53.501069 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Request body: {'port': {'device_id': 'c6fae069-4b34-4e39-b7d2-d6557ea6519d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:45:53.671029 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:53.771177 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5469a1-7868-4fde-b435-acd5693e7cc6 req-4f85b2fa-842b-4bad-b307-6fd362210128 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:53.772067 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-8b5469a1-7868-4fde-b435-acd5693e7cc6 req-4f85b2fa-842b-4bad-b307-6fd362210128 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Synchronizing usage tracker for tenant:8756a7c99bc647a39be9c326450af98a on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:45:53.797109 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:53.902717 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-8b5469a1-7868-4fde-b435-acd5693e7cc6 req-4f85b2fa-842b-4bad-b307-6fd362210128 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Unset dirty status for tenant:8756a7c99bc647a39be9c326450af98a on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:45:53.903880 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8b5469a1-7868-4fde-b435-acd5693e7cc6 req-4f85b2fa-842b-4bad-b307-6fd362210128 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 935 time: 0.3158615 May 26 14:45:54.056436 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-8b5469a1-7868-4fde-b435-acd5693e7cc6 req-421e5c1d-25ce-48ad-97b6-e63362c85a90 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Synchronizing usage tracker for tenant:8756a7c99bc647a39be9c326450af98a on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:45:54.103073 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6576671-fb5b-4b8f-85aa-041edc3ec6e0 req-f8627853-1c6d-418b-89c2-0f9512308196 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:54.104561 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a6576671-fb5b-4b8f-85aa-041edc3ec6e0 req-f8627853-1c6d-418b-89c2-0f9512308196 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.2868454 May 26 14:45:54.141534 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-8b5469a1-7868-4fde-b435-acd5693e7cc6 req-421e5c1d-25ce-48ad-97b6-e63362c85a90 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Unset dirty status for tenant:8756a7c99bc647a39be9c326450af98a on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:45:54.142640 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8b5469a1-7868-4fde-b435-acd5693e7cc6 req-421e5c1d-25ce-48ad-97b6-e63362c85a90 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2140641 May 26 14:45:54.186201 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a6576671-fb5b-4b8f-85aa-041edc3ec6e0 req-f7a4e7ed-18e8-4cc3-a666-cc52ad2f3ead tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0720985 May 26 14:45:54.251391 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 07c99fe4-b739-48a8-b269-6578cdfef012 {{(pid=98445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:45:54.311549 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:54.360769 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Transition to ACTIVE for port object 07c99fe4-b739-48a8-b269-6578cdfef012 will not be triggered until provisioned by entity L2. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:45:54.372817 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:54.386763 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7c7a5027-236b-4b44-b603-ef38db19199e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:54.438027 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5968bb41-5f8f-425c-bc87-b72863cd90b5 req-6b315e71-530d-4b80-96e7-1fae29aeac24 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:54.439538 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5968bb41-5f8f-425c-bc87-b72863cd90b5 req-6b315e71-530d-4b80-96e7-1fae29aeac24 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1828213 May 26 14:45:54.560235 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Pushing event updated for resources: {'Port': ['ID=07c99fe4-b739-48a8-b269-6578cdfef012,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:54.560715 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:54.564356 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:54.674501 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5968bb41-5f8f-425c-bc87-b72863cd90b5 req-34796f90-13aa-472b-87bf-291d3f8e9690 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2181172 May 26 14:45:54.808506 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-0074490e-9b73-4837-bb52-d693784863d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:54.809895 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-0074490e-9b73-4837-bb52-d693784863d7 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 1098 time: 0.0748079 May 26 14:45:54.922575 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Attempting to bind port 07c99fe4-b739-48a8-b269-6578cdfef012 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:45:54.923214 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Attempting to bind port 07c99fe4-b739-48a8-b269-6578cdfef012 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:45:54.923214 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Attempting to bind port 07c99fe4-b739-48a8-b269-6578cdfef012 on network 14d03d57-1203-4ea8-864d-d000917df145 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:45:54.938902 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Port 07c99fe4-b739-48a8-b269-6578cdfef012 on network 14d03d57-1203-4ea8-864d-d000917df145 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:45:54.939219 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Attempting to bind port 07c99fe4-b739-48a8-b269-6578cdfef012 on network 14d03d57-1203-4ea8-864d-d000917df145 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:45:54.950168 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 45, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:45:54.950530 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Checking segment: {'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:45:54.950939 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Bound using segment: {'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:45:54.951379 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Bound port: 07c99fe4-b739-48a8-b269-6578cdfef012, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '46de2e99-b232-4f85-b906-225f5c51afe6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1148, 'network_id': '14d03d57-1203-4ea8-864d-d000917df145'}}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:45:54.951711 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:55.002827 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-bcfaa8c7-7bab-4ee8-a66b-0b210773b2d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.004283 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-bcfaa8c7-7bab-4ee8-a66b-0b210773b2d2 service neutron] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 913 time: 0.1866980 May 26 14:45:55.016713 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-17c83262-c470-4757-a2b6-6325f372d9fa req-2e9c0c66-2b99-4880-b35d-9567c0e4d455 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1249146 May 26 14:45:55.027657 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14929ccc-7b2f-4f50-9f59-d30887590d0e req-72f0581a-edbd-43a3-83e0-9e3afb93a3f6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.029243 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-14929ccc-7b2f-4f50-9f59-d30887590d0e req-72f0581a-edbd-43a3-83e0-9e3afb93a3f6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.3260293 May 26 14:45:55.078154 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e51335-274c-454d-aca0-1096f9070335 req-950ad89b-212d-4033-8034-76293e213306 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.079496 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-85e51335-274c-454d-aca0-1096f9070335 req-950ad89b-212d-4033-8034-76293e213306 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.2296100 May 26 14:45:55.141285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] For port 07c99fe4-b739-48a8-b269-6578cdfef012, host hv-cinder-77459, cleared binding levels {{(pid=98445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:45:55.146055 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-14929ccc-7b2f-4f50-9f59-d30887590d0e req-c19a6f0c-03eb-4848-ae22-b51628ef332f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1054258 May 26 14:45:55.168552 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] For port 07c99fe4-b739-48a8-b269-6578cdfef012, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=07c99fe4-b739-48a8-b269-6578cdfef012,segment=NetworkSegment(46de2e99-b232-4f85-b906-225f5c51afe6),segment_id=46de2e99-b232-4f85-b906-225f5c51afe6)] {{(pid=98445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:45:55.191359 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-a5863ff3-8647-4d86-bb5e-f078a9ec0385 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0 HTTP/1.1" status: 200 len: 1001 time: 0.1737339 May 26 14:45:55.194281 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-85e51335-274c-454d-aca0-1096f9070335 req-4a6097ff-0c2e-4e07-8260-d4f9e2907704 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0936584 May 26 14:45:55.199467 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:55.205528 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cd246859-6f78-4713-b26d-549dec9c3008 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:55.251651 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c83262-c470-4757-a2b6-6325f372d9fa req-9d81f370-7cdc-4116-bbc1-77bdb6ad5031 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.253326 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-17c83262-c470-4757-a2b6-6325f372d9fa req-9d81f370-7cdc-4116-bbc1-77bdb6ad5031 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 1099 time: 0.1816759 May 26 14:45:55.296826 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Pushing event updated for resources: {'Port': ['ID=07c99fe4-b739-48a8-b269-6578cdfef012,revision_number=3']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:55.318000 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-7d8874bf-da89-42dd-9c06-2a5c6a66af79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.319705 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-7d8874bf-da89-42dd-9c06-2a5c6a66af79 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.1183715 May 26 14:45:55.337131 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:55.352691 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.353409 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:55.355112 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] 10.222.0.79 "PUT /v2.0/ports/07c99fe4-b739-48a8-b269-6578cdfef012 HTTP/1.1" status: 200 len: 1097 time: 1.8584647 May 26 14:45:55.355756 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c6fae069-4b34-4e39-b7d2-d6557ea6519d', 'tag': '07c99fe4-b739-48a8-b269-6578cdfef012'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:45:55.477468 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c6fae069-4b34-4e39-b7d2-d6557ea6519d', 'tag': '07c99fe4-b739-48a8-b269-6578cdfef012', 'status': 'completed', 'code': 200} May 26 14:45:55.526424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8549216a-fc98-4f8f-9195-ee410b35ea00 req-5c8b7e0b-801a-4673-92e9-7cee7b2585ee tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.527842 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8549216a-fc98-4f8f-9195-ee410b35ea00 req-5c8b7e0b-801a-4673-92e9-7cee7b2585ee tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 947 time: 0.2276721 May 26 14:45:55.594037 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8549216a-fc98-4f8f-9195-ee410b35ea00 req-91de9333-7726-4e56-96e0-4169b2fb0e8d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585132 May 26 14:45:55.596670 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-3b99678e-2b2d-488c-be36-93607f7cf374 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.605117 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-3b99678e-2b2d-488c-be36-93607f7cf374 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=8756a7c99bc647a39be9c326450af98a&device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 1100 time: 0.1665695 May 26 14:45:55.649678 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c83262-c470-4757-a2b6-6325f372d9fa req-ac606ee7-1039-4018-b1fc-0d8cb35f5438 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.651149 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-17c83262-c470-4757-a2b6-6325f372d9fa req-ac606ee7-1039-4018-b1fc-0d8cb35f5438 service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.3647456 May 26 14:45:55.692770 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-b44df57c-bcad-48e7-b1ea-04a7ddbda287 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.80&port_id=07c99fe4-b739-48a8-b269-6578cdfef012 HTTP/1.1" status: 200 len: 217 time: 0.0634408 May 26 14:45:55.715309 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-c7d4e895-0be3-4fd5-95db-7cf5669a158b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.717342 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-c7d4e895-0be3-4fd5-95db-7cf5669a158b service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3268890 May 26 14:45:55.733112 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-17c83262-c470-4757-a2b6-6325f372d9fa req-5c1dc2e3-9097-4be0-80be-8226af841435 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c HTTP/1.1" status: 200 len: 217 time: 0.0662298 May 26 14:45:55.766263 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1f56a5f5-c002-41ff-89ee-e2c3a04f8018 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.767803 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-1f56a5f5-c002-41ff-89ee-e2c3a04f8018 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c699aeff-c66c-4ae8-a570-fee2c07c0bd0 HTTP/1.1" status: 200 len: 843 time: 0.0673592 May 26 14:45:55.884219 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c83262-c470-4757-a2b6-6325f372d9fa req-d9e7197c-c652-4dc5-9f3a-cb175d99a1c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.890142 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:55.895837 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-17c83262-c470-4757-a2b6-6325f372d9fa req-d9e7197c-c652-4dc5-9f3a-cb175d99a1c9 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.1395214 May 26 14:45:55.919490 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-b5a393f0-724f-4919-9145-54f05c0a44fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.920959 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-b5a393f0-724f-4919-9145-54f05c0a44fc service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=14d03d57-1203-4ea8-864d-d000917df145&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1436903 May 26 14:45:55.937596 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c3efe6-a016-4b10-b098-8d6fd49f8960 req-46d14eee-c61f-4e68-90e0-534e76b81cf7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:55.939039 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c3efe6-a016-4b10-b098-8d6fd49f8960 req-46d14eee-c61f-4e68-90e0-534e76b81cf7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1267059 May 26 14:45:55.953622 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-17c83262-c470-4757-a2b6-6325f372d9fa req-560abcc6-d616-464a-8206-91f5aa28b708 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0436957 May 26 14:45:56.001192 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-c348aa65-d1cc-4db3-b72e-f206eee42474 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2699239 May 26 14:45:56.071150 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c3efe6-a016-4b10-b098-8d6fd49f8960 req-90eeb519-c314-4cb5-af26-308262a4b6a3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103160 May 26 14:45:56.109523 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-515a8fa0-3f44-4647-aed0-c873861a91f8 service neutron] 10.222.0.79 "GET /v2.0/networks/14d03d57-1203-4ea8-864d-d000917df145?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1805046 May 26 14:45:56.202872 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-17c83262-c470-4757-a2b6-6325f372d9fa req-671ccf5a-e8f3-4122-bead-928cc6683e63 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2349262 May 26 14:45:56.263108 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3f7110-8ad4-438e-9c83-756ed296f2f2 req-d487283d-59b8-4400-a1eb-f3b16ef51da4 service neutron] 10.222.0.79 "GET /v2.0/networks/14d03d57-1203-4ea8-864d-d000917df145?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1452062 May 26 14:45:56.309411 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b0bb1531-a532-4cf9-ae21-41e5d4fd9e55 req-124f9663-6b1c-41fc-b176-b56e6aa72b76 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2642684 May 26 14:45:56.377050 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91b923f-cbe2-445c-bf5f-0e1490b6c267 req-bc85f307-2026-4bc9-a904-99b5ea0e9705 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:56.378580 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b91b923f-cbe2-445c-bf5f-0e1490b6c267 req-bc85f307-2026-4bc9-a904-99b5ea0e9705 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0936618 May 26 14:45:56.380809 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-17c83262-c470-4757-a2b6-6325f372d9fa req-12f2ce94-a1fd-45a5-9dfa-a70a3073497e service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1615601 May 26 14:45:56.429453 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b91b923f-cbe2-445c-bf5f-0e1490b6c267 req-3b6f29ea-59d0-4605-8835-5367f5d939fa tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436451 May 26 14:45:56.529133 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:45:56.573127 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a133da2e-a2bc-4a4a-846d-cd02cd1720fe req-0ce7392b-16d4-4808-b23d-281a9d06d0e0 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:56.581306 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a133da2e-a2bc-4a4a-846d-cd02cd1720fe req-0ce7392b-16d4-4808-b23d-281a9d06d0e0 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1220248 May 26 14:45:56.691594 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-e43c5ffe-c49f-4788-97fb-1544276d1f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:56.694209 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-e43c5ffe-c49f-4788-97fb-1544276d1f38 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=8756a7c99bc647a39be9c326450af98a&device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 1100 time: 0.1710722 May 26 14:45:56.717204 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a133da2e-a2bc-4a4a-846d-cd02cd1720fe req-31355594-44f2-403b-9809-2f350db6ad8a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0914967 May 26 14:45:56.754201 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe06b4d-f8d8-400c-9d49-71b09491b226 req-7adb9337-ca65-43a7-a32e-0978f275df8e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:56.756555 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cbe06b4d-f8d8-400c-9d49-71b09491b226 req-7adb9337-ca65-43a7-a32e-0978f275df8e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1740539 May 26 14:45:56.760324 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:56.778088 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'port_id': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'mac_address': 'fa:16:3e:1e:15:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:45:56.805826 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cbe06b4d-f8d8-400c-9d49-71b09491b226 req-e5d0fc40-c8ac-4bf8-88d8-a513032d0c2f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433924 May 26 14:45:56.848868 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:56.873044 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 8553a1c9-db24-4d4f-8d37-0a358f73ac23 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:45:56.894136 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:56.900632 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:56.902920 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:56.932708 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-925c5406-fae9-4404-b8f2-835fec9aa52d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:56.935401 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-925c5406-fae9-4404-b8f2-835fec9aa52d service neutron] 10.222.0.79 "GET /v2.0/networks?id=14d03d57-1203-4ea8-864d-d000917df145 HTTP/1.1" status: 200 len: 871 time: 0.1727555 May 26 14:45:56.938321 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-8992e502-90d0-44ff-97ed-6a7c015db6ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:56.940192 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-8992e502-90d0-44ff-97ed-6a7c015db6ab service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1098 time: 0.2332735 May 26 14:45:56.984604 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=6']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:56.988591 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:57.033058 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a019bb2-021c-412c-8931-a659d4290de3 req-39dd45a0-13df-4721-8042-a3c0accef53a tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:57.034671 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0a019bb2-021c-412c-8931-a659d4290de3 req-39dd45a0-13df-4721-8042-a3c0accef53a tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 947 time: 0.1069973 May 26 14:45:57.087388 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0a019bb2-021c-412c-8931-a659d4290de3 req-d6cda1d9-140c-4ba5-bf5a-84ba91523aa6 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451825 May 26 14:45:57.096136 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-77ad52c2-73a9-40b6-a16a-0c718a18701e service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.80&port_id=07c99fe4-b739-48a8-b269-6578cdfef012 HTTP/1.1" status: 200 len: 217 time: 0.1528542 May 26 14:45:57.174990 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de2b28c-dfd7-4450-a690-fadce8e9b25c req-e519a53f-7677-451b-b1d1-fed596aa7da1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:57.176478 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4de2b28c-dfd7-4450-a690-fadce8e9b25c req-e519a53f-7677-451b-b1d1-fed596aa7da1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 945 time: 0.0869043 May 26 14:45:57.202703 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-2639a5fc-c632-473c-910d-4a4ba55a60e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:57.204187 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-2639a5fc-c632-473c-910d-4a4ba55a60e8 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=c699aeff-c66c-4ae8-a570-fee2c07c0bd0 HTTP/1.1" status: 200 len: 843 time: 0.0950339 May 26 14:45:57.208944 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-b82e0446-f3e7-4a68-8490-88a0189ea192 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:57.210388 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-b82e0446-f3e7-4a68-8490-88a0189ea192 service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.2060142 May 26 14:45:57.223330 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4de2b28c-dfd7-4450-a690-fadce8e9b25c req-b9bf961d-2020-4e2c-8ab6-d0f2ed42e0d7 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406942 May 26 14:45:57.333006 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-77e3fe1b-ea10-4f65-9b59-d77fd5b763d3 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 200 len: 217 time: 0.0707028 May 26 14:45:57.472788 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:57.476318 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['8553a1c9-db24-4d4f-8d37-0a358f73ac23'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:45:57.516329 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-0bef331e-540e-45d5-a603-0b361b096255 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:57.517757 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-0bef331e-540e-45d5-a603-0b361b096255 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.1734560 May 26 14:45:57.531958 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-2f4cbe75-8bca-42cd-9ddd-0cb9916afbb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:57.533380 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-2f4cbe75-8bca-42cd-9ddd-0cb9916afbb7 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=14d03d57-1203-4ea8-864d-d000917df145&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.3052540 May 26 14:45:57.640386 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef75f55-550f-4176-9dc7-0564795d0fcb req-dd13a867-ae99-4201-bc5e-330707cf2cb2 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:57.645684 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-753feca0-6921-4951-830d-c01684ec86b6 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0524538 May 26 14:45:57.649839 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aef75f55-550f-4176-9dc7-0564795d0fcb req-dd13a867-ae99-4201-bc5e-330707cf2cb2 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 945 time: 0.0983741 May 26 14:45:57.698080 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aef75f55-550f-4176-9dc7-0564795d0fcb req-fae8dcea-8950-4033-98bd-2bd3675b7ef7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471549 May 26 14:45:57.936457 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-a463b57a-7c63-491f-a64e-333ce02038e6 service neutron] 10.222.0.79 "GET /v2.0/networks/14d03d57-1203-4ea8-864d-d000917df145?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3616378 May 26 14:45:57.940314 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-0c875ab4-0603-487f-a9b4-bf84ccdec288 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2451274 May 26 14:45:58.111288 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c45fca4f-2f8c-4961-9ff0-ffe592e50727 req-753d6e9c-096e-4f1b-8cd2-853b3dde23c7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:58.112847 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c45fca4f-2f8c-4961-9ff0-ffe592e50727 req-753d6e9c-096e-4f1b-8cd2-853b3dde23c7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.2685246 May 26 14:45:58.127626 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c2ccc5-fea6-4369-86c3-7067f29a4653 req-fe53b10c-0bfd-4669-99e2-4018b9c1903b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:58.129075 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-15c2ccc5-fea6-4369-86c3-7067f29a4653 req-fe53b10c-0bfd-4669-99e2-4018b9c1903b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1252797 May 26 14:45:58.199146 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c45fca4f-2f8c-4961-9ff0-ffe592e50727 req-60c5292c-c353-4879-b58b-fa2551ea4d90 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690815 May 26 14:45:58.203978 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-15c2ccc5-fea6-4369-86c3-7067f29a4653 req-80e7c11c-5298-4f8b-b676-54442228db6e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596089 May 26 14:45:58.218198 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d3bbd617-b1b2-4b00-94d5-8962915a3911 req-0e1d8623-74d4-43c4-9a8f-7682b2ebab5f service neutron] 10.222.0.79 "GET /v2.0/networks/14d03d57-1203-4ea8-864d-d000917df145?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2501132 May 26 14:45:58.219032 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b31cc8c-24a5-4a9c-abb0-c8a7ca262e47 req-68869188-9511-4e18-8323-1e02de7cbff5 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2227995 May 26 14:45:58.452927 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb3dc1c5-7613-43ba-9c1d-5c847c602df4 req-4513d11c-2c0c-4258-8caf-9538a1413624 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:58.454284 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb3dc1c5-7613-43ba-9c1d-5c847c602df4 req-4513d11c-2c0c-4258-8caf-9538a1413624 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 945 time: 0.1150455 May 26 14:45:58.461995 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afe023b-f004-4633-8841-6f7a1964bdde req-6d69789d-dacf-4a78-a2d5-20c470cde8e1 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:58.463428 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1afe023b-f004-4633-8841-6f7a1964bdde req-6d69789d-dacf-4a78-a2d5-20c470cde8e1 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 947 time: 0.1556554 May 26 14:45:58.530615 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:45:58.535568 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb3dc1c5-7613-43ba-9c1d-5c847c602df4 req-1b6e0ed3-b10f-45ba-9cc9-9ba1fab94efa tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712183 May 26 14:45:58.544472 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1afe023b-f004-4633-8841-6f7a1964bdde req-11062347-bd17-433a-94e1-d9a33c635cac tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659020 May 26 14:45:58.600813 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:45:58.601197 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:58.734345 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:58.761308 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:45:58.775041 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:45:58.780640 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:45:58.782919 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:45:58.818138 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'code': 200} May 26 14:45:58.854907 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=7']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:45:58.858005 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:45:58.901067 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc041f1-bbd7-4a6d-9dac-c0ae585d86f7 req-b742cf1d-b86c-4d2e-87c6-ab9a4ad60807 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:58.902573 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8dc041f1-bbd7-4a6d-9dac-c0ae585d86f7 req-b742cf1d-b86c-4d2e-87c6-ab9a4ad60807 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0814521 May 26 14:45:58.949851 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8dc041f1-bbd7-4a6d-9dac-c0ae585d86f7 req-1a4088ae-31ec-4d42-a0f5-76718e4af759 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405135 May 26 14:45:59.418700 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d6ad21-abd3-413b-9fad-ffeab6a13369 req-91a6ded3-3492-4ecb-81af-fa92701d6841 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:59.420420 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f8d6ad21-abd3-413b-9fad-ffeab6a13369 req-91a6ded3-3492-4ecb-81af-fa92701d6841 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0884798 May 26 14:45:59.469977 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f8d6ad21-abd3-413b-9fad-ffeab6a13369 req-0eb1ec72-e98b-4639-a897-e5d41c48f035 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435786 May 26 14:45:59.838854 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71614201-1a37-4b4b-847d-3e173e759f78 req-4287d2ce-f3de-42d3-a3fc-bad1017d91f5 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:59.840340 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-71614201-1a37-4b4b-847d-3e173e759f78 req-4287d2ce-f3de-42d3-a3fc-bad1017d91f5 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 947 time: 0.1565177 May 26 14:45:59.847664 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17568ac-bf05-40ef-9c42-c54b32209e33 req-7e65065f-0dd0-4173-9df5-b50537fe32a1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:45:59.849047 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d17568ac-bf05-40ef-9c42-c54b32209e33 req-7e65065f-0dd0-4173-9df5-b50537fe32a1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 945 time: 0.1129105 May 26 14:45:59.922352 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-71614201-1a37-4b4b-847d-3e173e759f78 req-8a4504d4-b4c9-40b4-b735-95983864f97c tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721354 May 26 14:45:59.926966 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d17568ac-bf05-40ef-9c42-c54b32209e33 req-2350e0ef-35bf-452b-a116-661e3c62f682 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606000 May 26 14:46:00.200793 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675fae20-2978-49fb-bb3b-4384eb36c7b9 req-8b5a720d-6b60-4093-877d-b8f8d89bd499 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:00.202258 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-675fae20-2978-49fb-bb3b-4384eb36c7b9 req-8b5a720d-6b60-4093-877d-b8f8d89bd499 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1098151 May 26 14:46:00.265437 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-675fae20-2978-49fb-bb3b-4384eb36c7b9 req-710b818c-653f-49a7-b3b2-003244078737 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0556235 May 26 14:46:00.462037 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2286526-8544-4953-82c6-27e1796d1188 req-7b4cbce2-9d23-42e2-a467-4753c11d696a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:00.462823 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-b2286526-8544-4953-82c6-27e1796d1188 req-7b4cbce2-9d23-42e2-a467-4753c11d696a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Synchronizing usage tracker for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:46:00.477378 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-b2286526-8544-4953-82c6-27e1796d1188 req-7b4cbce2-9d23-42e2-a467-4753c11d696a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Unset dirty status for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:46:00.478540 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2286526-8544-4953-82c6-27e1796d1188 req-7b4cbce2-9d23-42e2-a467-4753c11d696a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 945 time: 0.1479073 May 26 14:46:00.536685 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 07c99fe4-b739-48a8-b269-6578cdfef012 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:46:00.680102 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Deleting port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:46:00.680441 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:00.740529 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4990bc00-5da6-4d0e-b963-af2565ee8bae req-6d1422f0-9585-4013-9a0b-b5ffdbbe69eb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:00.743303 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4990bc00-5da6-4d0e-b963-af2565ee8bae req-6d1422f0-9585-4013-9a0b-b5ffdbbe69eb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1164842 May 26 14:46:00.799448 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 07c99fe4-b739-48a8-b269-6578cdfef012, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=07c99fe4-b739-48a8-b269-6578cdfef012,segment=NetworkSegment(46de2e99-b232-4f85-b906-225f5c51afe6),segment_id=46de2e99-b232-4f85-b906-225f5c51afe6)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:00.839417 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '07c99fe4-b739-48a8-b269-6578cdfef012', 'network_id': '14d03d57-1203-4ea8-864d-d000917df145', 'port_id': '07c99fe4-b739-48a8-b269-6578cdfef012', 'mac_address': 'fa:16:3e:e2:4a:87', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1148, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c699aeff-c66c-4ae8-a570-fee2c07c0bd0', 'ip_address': '192.168.233.80'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:46:00.869829 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4990bc00-5da6-4d0e-b963-af2565ee8bae req-d4e39f93-7a46-4710-8c04-9445f6adf5a6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1141217 May 26 14:46:00.923299 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:00.933386 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] For port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:00.934037 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:00.956064 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 07c99fe4-b739-48a8-b269-6578cdfef012 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:46:00.987728 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 07c99fe4-b739-48a8-b269-6578cdfef012, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=07c99fe4-b739-48a8-b269-6578cdfef012,segment=NetworkSegment(46de2e99-b232-4f85-b906-225f5c51afe6),segment_id=46de2e99-b232-4f85-b906-225f5c51afe6)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:00.994537 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:00.996687 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-f2aff81a-68f6-454e-b8a7-3a45cbb75370 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:01.139752 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=07c99fe4-b739-48a8-b269-6578cdfef012,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:01.144146 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:01.225242 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Calling delete_port for a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:46:01.370386 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed981e5-9ce9-4451-80ae-02b79b23f2a9 req-835d220d-e57d-4115-9c4b-772d661ecffc tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:01.380598 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ed981e5-9ce9-4451-80ae-02b79b23f2a9 req-835d220d-e57d-4115-9c4b-772d661ecffc tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 945 time: 0.2589581 May 26 14:46:01.419444 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37572a13-f5fa-4aee-9838-2ed1ecd5951d req-262f600c-9c29-452f-8103-a194d8cf09fd tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:01.427284 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-37572a13-f5fa-4aee-9838-2ed1ecd5951d req-262f600c-9c29-452f-8103-a194d8cf09fd tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 948 time: 0.1974471 May 26 14:46:01.498328 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ed981e5-9ce9-4451-80ae-02b79b23f2a9 req-5eb1fe62-beda-4781-9f8e-46b69c8500c1 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1157458 May 26 14:46:01.502537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:01.516121 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:01.518743 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['07c99fe4-b739-48a8-b269-6578cdfef012'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:46:01.575158 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Pushing event deleted for resources: {'Port': ['ID=a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:01.584157 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.584540 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.585018 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.585617 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.586244 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.586946 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.587308 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.587822 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-37572a13-f5fa-4aee-9838-2ed1ecd5951d req-be238d45-1937-42ec-a98d-63ae1f976efc tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1594236 May 26 14:46:01.588019 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.588322 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.588668 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.589015 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.589360 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:01.641258 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:01.684012 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] No DVR routers for this DVR port a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:46:01.686728 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:01.696738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff7e548f-59bc-43b2-8eff-666dd795446a', 'name': 'network-vif-deleted', 'tag': 'a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:01.705203 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b2286526-8544-4953-82c6-27e1796d1188 req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "DELETE /v2.0/ports/a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 HTTP/1.1" status: 204 len: 173 time: 1.2202921 May 26 14:46:01.764273 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff7e548f-59bc-43b2-8eff-666dd795446a', 'name': 'network-vif-deleted', 'tag': 'a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286', 'status': 'completed', 'code': 200} May 26 14:46:01.783705 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb56d3fc-1243-4d2b-a89c-2c87635fd93c req-e63042e6-9874-4b23-8089-21d748273913 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:01.792264 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cb56d3fc-1243-4d2b-a89c-2c87635fd93c req-e63042e6-9874-4b23-8089-21d748273913 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1365576 May 26 14:46:01.838795 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cb56d3fc-1243-4d2b-a89c-2c87635fd93c req-44094450-7b8c-4dde-945e-31169910247a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454998 May 26 14:46:02.082955 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2941e8c1-4379-4576-9787-f5d8919b21ee req-f8e44cd1-758b-43fb-91a8-5d878f436bde tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:02.084673 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2941e8c1-4379-4576-9787-f5d8919b21ee req-f8e44cd1-758b-43fb-91a8-5d878f436bde tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0955496 May 26 14:46:02.143873 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2941e8c1-4379-4576-9787-f5d8919b21ee req-0a1d5c8b-f5d9-413c-95c6-ebbb7cfb89ae tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530207 May 26 14:46:02.720923 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a87605e2-96b8-4c64-a50f-4f795e1f4b55 req-2c1bfdd0-f5d4-4913-9407-bdf71db1e13c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 210 time: 0.0471075 May 26 14:46:02.831115 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ebcfc9-1134-4a78-9fa9-0db44609e313 req-f8f3cc5f-625d-4869-921f-ad3e608a338f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:02.833386 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-10ebcfc9-1134-4a78-9fa9-0db44609e313 req-f8f3cc5f-625d-4869-921f-ad3e608a338f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 948 time: 0.0802584 May 26 14:46:02.895965 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-10ebcfc9-1134-4a78-9fa9-0db44609e313 req-a1a0747e-dfdc-467e-912c-750111182590 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564365 May 26 14:46:03.050530 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee248d4e-f58b-4221-8f5b-ff2735313102 req-3d795e1a-7530-4ed5-8807-616533129078 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:03.051989 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ee248d4e-f58b-4221-8f5b-ff2735313102 req-3d795e1a-7530-4ed5-8807-616533129078 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0817919 May 26 14:46:03.109162 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ee248d4e-f58b-4221-8f5b-ff2735313102 req-d38e917e-bdff-4bcb-a41f-83221d223d03 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471036 May 26 14:46:03.919000 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-369e9293-d7fb-46ad-a009-754be2819b2c req-26023401-ce30-48e7-ad75-6b7e0c84d052 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 210 time: 0.0503378 May 26 14:46:04.218183 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:46:04.223589 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568d2075-eeba-479f-a35b-9b2f20b46a92 req-e08092d2-cd59-4820-a7aa-b493b6ce47db tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:04.232893 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-568d2075-eeba-479f-a35b-9b2f20b46a92 req-e08092d2-cd59-4820-a7aa-b493b6ce47db tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 948 time: 0.2229204 May 26 14:46:04.337924 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-568d2075-eeba-479f-a35b-9b2f20b46a92 req-464d1aae-63e9-4e7f-9137-c371e4885eb8 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1035604 May 26 14:46:04.373392 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c060498-de7c-478a-bedf-b242247c10cf req-3e21e8e3-3904-497b-b33b-b966e8c955cf tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:04.375034 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c060498-de7c-478a-bedf-b242247c10cf req-3e21e8e3-3904-497b-b33b-b966e8c955cf tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1253011 May 26 14:46:04.428963 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c060498-de7c-478a-bedf-b242247c10cf req-7f5bda67-3156-4164-8e17-0ce6ba9468bc tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476050 May 26 14:46:04.727481 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:46:04.771847 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:46:04.772405 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device a3fcb3e3-ba1c-4b1b-81f6-4ce90a284286 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:46:05.136180 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bbf7d5ae-7832-4628-8ffd-7719bd049602 req-da59ec2d-ecae-4a1d-a33d-622b8fbb216c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=ff7e548f-59bc-43b2-8eff-666dd795446a HTTP/1.1" status: 200 len: 210 time: 0.0443807 May 26 14:46:05.572586 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991661e0-0e9d-43ca-970f-b97739532b44 req-b1a34279-b438-421b-b02b-a33ee132db8e tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:05.575333 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-991661e0-0e9d-43ca-970f-b97739532b44 req-b1a34279-b438-421b-b02b-a33ee132db8e tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 948 time: 0.1255784 May 26 14:46:05.675275 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ec4ee3ea-9d36-4c14-a225-a3445629295c', 'c15a8128-db77-479e-9b42-25276139f049', '6edfff02-2e00-4da7-8c08-37a887f1f08f'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:46:05.744802 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-991661e0-0e9d-43ca-970f-b97739532b44 req-053cc498-df52-4805-90b9-ed8255999693 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1608419 May 26 14:46:05.819028 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f6040b-d202-49e7-a1f4-0c640cf3f0e9 req-b92f08f7-a426-4383-8402-9b2851bab404 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:05.821028 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98f6040b-d202-49e7-a1f4-0c640cf3f0e9 req-b92f08f7-a426-4383-8402-9b2851bab404 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1964188 May 26 14:46:05.923585 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98f6040b-d202-49e7-a1f4-0c640cf3f0e9 req-f27b985c-20bd-4028-9423-cc46a8333cae tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0966563 May 26 14:46:06.442638 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0b15d3-ff14-4b6c-8d5e-b30a59c6b572 req-9352afa2-2324-4b27-8e6a-ed58186106fd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:06.445256 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aa0b15d3-ff14-4b6c-8d5e-b30a59c6b572 req-9352afa2-2324-4b27-8e6a-ed58186106fd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1112950 May 26 14:46:06.507794 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aa0b15d3-ff14-4b6c-8d5e-b30a59c6b572 req-681cd0b5-3806-432c-be05-04f2b5d03c3f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540068 May 26 14:46:06.714406 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 07c99fe4-b739-48a8-b269-6578cdfef012 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:46:06.794860 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 07c99fe4-b739-48a8-b269-6578cdfef012 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:46:06.800944 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 07c99fe4-b739-48a8-b269-6578cdfef012 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:46:06.801605 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:06.967358 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:07.015052 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6fae069-4b34-4e39-b7d2-d6557ea6519d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07c99fe4-b739-48a8-b269-6578cdfef012'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:07.030553 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 07c99fe4-b739-48a8-b269-6578cdfef012, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=07c99fe4-b739-48a8-b269-6578cdfef012,segment=NetworkSegment(46de2e99-b232-4f85-b906-225f5c51afe6),segment_id=46de2e99-b232-4f85-b906-225f5c51afe6)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:07.035641 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:07.039649 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3f81a227-11f9-4d84-9b4b-57a5a3a5a50a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:07.150445 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=07c99fe4-b739-48a8-b269-6578cdfef012,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:07.155177 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:07.305064 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ec2c87-3a77-4643-9d28-ef6254290a37 req-c7013857-d6cc-463f-bd5b-45ed15c17ea5 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:07.313017 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-47ec2c87-3a77-4643-9d28-ef6254290a37 req-c7013857-d6cc-463f-bd5b-45ed15c17ea5 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 949 time: 0.1731374 May 26 14:46:07.401626 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-47ec2c87-3a77-4643-9d28-ef6254290a37 req-b5c65aec-fae0-450f-9634-241b2ac433ab tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821946 May 26 14:46:07.493590 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4485d710-1935-49dc-9c50-2507c155dd9b req-913636c5-a631-449b-90f2-a02a09da9bcd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:07.496943 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4485d710-1935-49dc-9c50-2507c155dd9b req-913636c5-a631-449b-90f2-a02a09da9bcd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1603515 May 26 14:46:07.497080 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c6fae069-4b34-4e39-b7d2-d6557ea6519d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07c99fe4-b739-48a8-b269-6578cdfef012', 'code': 200} May 26 14:46:07.550241 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4485d710-1935-49dc-9c50-2507c155dd9b req-4e7894a3-029d-427a-8d1b-68b66597684a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446384 May 26 14:46:07.812542 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df6327c-a13a-4abb-99b4-87b432d2fb16 req-218eabd7-4558-4ce7-9a37-4309228783ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:07.814759 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5df6327c-a13a-4abb-99b4-87b432d2fb16 req-218eabd7-4558-4ce7-9a37-4309228783ed service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 1102 time: 0.0840077 May 26 14:46:07.862804 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5df6327c-a13a-4abb-99b4-87b432d2fb16 req-3d91f0aa-151b-4198-a243-08a5764298f2 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402970 May 26 14:46:08.067714 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c520f969-cf75-494b-b596-67a59822fa00 req-87699604-20f7-4576-9a18-c456a9ff317d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:08.069632 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c520f969-cf75-494b-b596-67a59822fa00 req-87699604-20f7-4576-9a18-c456a9ff317d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 946 time: 0.0945361 May 26 14:46:08.120980 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c520f969-cf75-494b-b596-67a59822fa00 req-f1180920-95c5-4fa4-9846-6c5d20a772dd tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451472 May 26 14:46:08.603442 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f164f4-aeb8-4597-8fd5-fa5b2f95aa39 req-9751812e-0a48-4ac0-9f76-40ab63312772 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:08.606000 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d2f164f4-aeb8-4597-8fd5-fa5b2f95aa39 req-9751812e-0a48-4ac0-9f76-40ab63312772 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 949 time: 0.0973845 May 26 14:46:08.655234 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d2f164f4-aeb8-4597-8fd5-fa5b2f95aa39 req-98d45630-15e5-4999-8694-1df6d450877a tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431216 May 26 14:46:08.755650 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e5de4e8-042f-4069-afab-621e148eba2a req-2b0c0130-631b-41eb-9c76-846860693a30 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:08.757162 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3e5de4e8-042f-4069-afab-621e148eba2a req-2b0c0130-631b-41eb-9c76-846860693a30 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0827315 May 26 14:46:08.803779 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3e5de4e8-042f-4069-afab-621e148eba2a req-153f6933-6040-40fd-9c0a-45654c44cd24 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404143 May 26 14:46:09.356344 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58caab54-aba2-498a-9a3f-756f61ab2aad req-dc6265de-6e25-4cca-92d9-a3be35fceb3a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:09.357821 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-58caab54-aba2-498a-9a3f-756f61ab2aad req-dc6265de-6e25-4cca-92d9-a3be35fceb3a tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 946 time: 0.1234109 May 26 14:46:09.415551 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-58caab54-aba2-498a-9a3f-756f61ab2aad req-4822156b-a0db-437c-a957-3640e49b2873 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517986 May 26 14:46:09.859205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a0603a-6a19-4e86-b619-685c8450527e req-4ae44cc2-a7e0-4399-bdfe-b54dd6badd60 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:09.860801 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a6a0603a-6a19-4e86-b619-685c8450527e req-4ae44cc2-a7e0-4399-bdfe-b54dd6badd60 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 949 time: 0.0898938 May 26 14:46:09.912211 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a6a0603a-6a19-4e86-b619-685c8450527e req-9e369ebf-3859-4cfa-a7af-fa3dae3e4d76 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448678 May 26 14:46:10.119550 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f349a73-ff88-4c1b-95a2-ddea48b3f201 req-a5daf4d8-9144-4491-8afe-d0d06d3901f3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:10.124350 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4f349a73-ff88-4c1b-95a2-ddea48b3f201 req-a5daf4d8-9144-4491-8afe-d0d06d3901f3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1437163 May 26 14:46:10.191472 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4f349a73-ff88-4c1b-95a2-ddea48b3f201 req-694d114d-62b9-45a0-b16a-7af1b1479416 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0576923 May 26 14:46:10.557295 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe361d4-5d08-4d46-85d3-8ecb41bf49c9 req-9e7b8a02-4a6d-4c9b-9fe8-aa10f3fbc187 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:10.558830 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cbe361d4-5d08-4d46-85d3-8ecb41bf49c9 req-9e7b8a02-4a6d-4c9b-9fe8-aa10f3fbc187 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 949 time: 0.1403821 May 26 14:46:10.672727 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cbe361d4-5d08-4d46-85d3-8ecb41bf49c9 req-e657553d-c6c4-45ef-8db5-46f03cb3b90c tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1035123 May 26 14:46:10.709798 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa633313-fff5-449a-92fb-cd3e0e0b4c55 req-db2a4ce3-239e-474c-a925-f1413d0de9e4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:10.709798 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa633313-fff5-449a-92fb-cd3e0e0b4c55 req-db2a4ce3-239e-474c-a925-f1413d0de9e4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 946 time: 0.1386645 May 26 14:46:10.769019 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fa633313-fff5-449a-92fb-cd3e0e0b4c55 req-46c03dee-b5d1-4b9b-8dda-82a4764f1016 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583439 May 26 14:46:10.826130 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-3af12c85-c48e-4d11-87e5-20f128c9a242 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:10.827219 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-3af12c85-c48e-4d11-87e5-20f128c9a242 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Synchronizing usage tracker for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:46:10.848906 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-3af12c85-c48e-4d11-87e5-20f128c9a242 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Unset dirty status for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:46:10.850541 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-3af12c85-c48e-4d11-87e5-20f128c9a242 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 946 time: 0.1251316 May 26 14:46:11.117965 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Deleting port 6edfff02-2e00-4da7-8c08-37a887f1f08f {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:46:11.118374 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:11.287768 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] For port 6edfff02-2e00-4da7-8c08-37a887f1f08f, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=6edfff02-2e00-4da7-8c08-37a887f1f08f,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:11.288253 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:11.461100 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Calling delete_port for 6edfff02-2e00-4da7-8c08-37a887f1f08f owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:46:11.499835 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458c4b33-b3b5-493c-89bc-3899f2b86567 req-260d3507-91a5-41ac-beff-8c125e25ad59 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:11.501700 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-458c4b33-b3b5-493c-89bc-3899f2b86567 req-260d3507-91a5-41ac-beff-8c125e25ad59 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1418927 May 26 14:46:11.561020 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-458c4b33-b3b5-493c-89bc-3899f2b86567 req-2866c38e-cdcf-45cc-9a04-991234d68f99 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480454 May 26 14:46:11.654556 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:11.660770 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b0eec507-c281-45c9-be93-dd9e79522188 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:11.705887 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ec4ee3ea-9d36-4c14-a225-a3445629295c', 'c15a8128-db77-479e-9b42-25276139f049', '6edfff02-2e00-4da7-8c08-37a887f1f08f'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:46:11.711662 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Pushing event deleted for resources: {'Port': ['ID=6edfff02-2e00-4da7-8c08-37a887f1f08f,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:11.714975 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:11.807225 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] No DVR routers for this DVR port 6edfff02-2e00-4da7-8c08-37a887f1f08f on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:46:11.809942 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:11.815086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '932955a5-6814-4e65-b44e-7e16f6c372fe', 'name': 'network-vif-deleted', 'tag': '6edfff02-2e00-4da7-8c08-37a887f1f08f'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:11.821877 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 42926) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:11.837924 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-76d0cd2c-2e7b-4a37-bdcb-0769a072a7ac req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "DELETE /v2.0/ports/6edfff02-2e00-4da7-8c08-37a887f1f08f HTTP/1.1" status: 204 len: 173 time: 0.9803987 May 26 14:46:12.075762 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c9617d47-2596-422e-a89e-322777d228b5 req-5041fc64-d6ac-43ad-906b-7004dc097fda tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=932955a5-6814-4e65-b44e-7e16f6c372fe HTTP/1.1" status: 200 len: 210 time: 0.1543167 May 26 14:46:12.079223 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:12.098558 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:12.102481 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Usage tracker for resource:security_group_rule and tenant:78cad03c51904886aedce6dcffa18118 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:12.105494 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:12.111725 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:12.121696 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b465fa-15b1-4bee-8326-4edd04973072 req-657a5e75-1dbe-41f3-a6a8-c9fb624ca01f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:12.123403 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06b465fa-15b1-4bee-8326-4edd04973072 req-657a5e75-1dbe-41f3-a6a8-c9fb624ca01f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 949 time: 0.2722001 May 26 14:46:12.151804 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '932955a5-6814-4e65-b44e-7e16f6c372fe', 'name': 'network-vif-deleted', 'tag': '6edfff02-2e00-4da7-8c08-37a887f1f08f', 'status': 'completed', 'code': 200} May 26 14:46:12.196983 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06b465fa-15b1-4bee-8326-4edd04973072 req-10b92f40-2804-4b59-be61-1df97cbcdbe6 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638058 May 26 14:46:12.260993 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:12.265127 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:12.271739 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:12.315542 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a19366ba-2f84-4ea2-a5a9-f5e77ecbc170,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:12.319022 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:12.321367 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=78cad03c51904886aedce6dcffa18118&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4981585 May 26 14:46:12.324167 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 42934) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:12.383677 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b6b8cb0-4259-46e8-b0c9-c7880c37d0b4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:12.409322 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b6b8cb0-4259-46e8-b0c9-c7880c37d0b4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:12.463205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b6b8cb0-4259-46e8-b0c9-c7880c37d0b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:12.467072 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-99178bee-89cd-45f4-be82-186cfc9b765c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:12.478230 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b6b8cb0-4259-46e8-b0c9-c7880c37d0b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a19366ba-2f84-4ea2-a5a9-f5e77ecbc170,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:12.482000 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9b6b8cb0-4259-46e8-b0c9-c7880c37d0b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:12.485536 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b6b8cb0-4259-46e8-b0c9-c7880c37d0b4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:12.486739 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9b6b8cb0-4259-46e8-b0c9-c7880c37d0b4 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a19366ba-2f84-4ea2-a5a9-f5e77ecbc170 HTTP/1.1" status: 204 len: 168 time: 0.1617312 May 26 14:46:12.528897 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-641b0d37-cf32-434c-87e2-051d2b7624cc tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:12.530433 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-641b0d37-cf32-434c-87e2-051d2b7624cc tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.79 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 949 time: 0.0914845 May 26 14:46:12.724717 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-de6d03a4-ef62-4802-beb6-7485774e2d14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:12.726252 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-de6d03a4-ef62-4802-beb6-7485774e2d14 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 1099 time: 0.1949384 May 26 14:46:12.832741 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Deleting port 07c99fe4-b739-48a8-b269-6578cdfef012 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:46:12.833095 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:12.866253 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5706fa-ca16-4137-a4cc-cafdeac2bd09 req-f0bb6fc1-2b09-4f30-8ff9-78f4f5c625b3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:12.869739 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3f5706fa-ca16-4137-a4cc-cafdeac2bd09 req-f0bb6fc1-2b09-4f30-8ff9-78f4f5c625b3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.1750729 May 26 14:46:12.931223 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3f5706fa-ca16-4137-a4cc-cafdeac2bd09 req-f46ea74a-0d91-4257-a5e2-55b3352f140b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0551412 May 26 14:46:12.984315 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-38b43790-7aed-4f9e-aca7-c34173dc1099 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:12.985854 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-38b43790-7aed-4f9e-aca7-c34173dc1099 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.2505536 May 26 14:46:13.089463 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] For port 07c99fe4-b739-48a8-b269-6578cdfef012, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=07c99fe4-b739-48a8-b269-6578cdfef012,segment=NetworkSegment(46de2e99-b232-4f85-b906-225f5c51afe6),segment_id=46de2e99-b232-4f85-b906-225f5c51afe6)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:13.089911 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.245239 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Calling delete_port for 07c99fe4-b739-48a8-b269-6578cdfef012 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:46:13.256145 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-7b40193d-cc34-4d0b-836c-87eb4ffcc477 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23 HTTP/1.1" status: 200 len: 1001 time: 0.2604642 May 26 14:46:13.371477 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 42976) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:13.435397 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714b82bc-d166-4eee-951e-784ca10f14ba req-12be8833-c62a-407b-b3d4-cb3be70d0d4b tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:13.445353 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-714b82bc-d166-4eee-951e-784ca10f14ba req-12be8833-c62a-407b-b3d4-cb3be70d0d4b tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 949 time: 0.1171007 May 26 14:46:13.511713 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-714b82bc-d166-4eee-951e-784ca10f14ba req-134c8e7a-bb95-42c9-a44d-129a98f7c4cc tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/security-groups?id=471f38f4-1786-4c47-8539-c40e07a726ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650852 May 26 14:46:13.548098 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1369650357-network', 'tenant_id': 'd1a7192ff14647f894360c51e8ceac5b'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:46:13.556188 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:13.561293 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Usage tracker for resource:network and tenant:d1a7192ff14647f894360c51e8ceac5b is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:13.563088 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-a8e9ccb8-866c-4204-afff-2233b74243be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:13.564533 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-a8e9ccb8-866c-4204-afff-2233b74243be service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.2941055 May 26 14:46:13.564944 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:13.572568 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:13.620371 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.629238 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Made reservation on behalf of d1a7192ff14647f894360c51e8ceac5b for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:46:13.629775 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-594ca87c-81c5-4be0-b428-eeba0fedd9f1 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:13.631865 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.651540 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.664190 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['07c99fe4-b739-48a8-b269-6578cdfef012'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:46:13.673283 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:13.679601 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Usage tracker for resource:security_group_rule and tenant:d1a7192ff14647f894360c51e8ceac5b is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:13.683367 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:13.684730 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Pushing event deleted for resources: {'Port': ['ID=07c99fe4-b739-48a8-b269-6578cdfef012,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:13.687323 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:13.696079 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:13.707283 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d661bd5d-2517-421c-9760-a42d4491aa6c req-9a7dd06b-14cd-400e-9e09-4c4bc2241217 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:13.710772 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d661bd5d-2517-421c-9760-a42d4491aa6c req-9a7dd06b-14cd-400e-9e09-4c4bc2241217 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 945 time: 0.1399686 May 26 14:46:13.774446 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] No DVR routers for this DVR port 07c99fe4-b739-48a8-b269-6578cdfef012 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:46:13.775442 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d661bd5d-2517-421c-9760-a42d4491aa6c req-50d93f72-b270-4127-b1d0-1c2384074f5b tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0600204 May 26 14:46:13.777210 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.806477 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-4532a5e7-b164-4690-a14d-992b739f8bf9 req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.79 "DELETE /v2.0/ports/07c99fe4-b739-48a8-b269-6578cdfef012 HTTP/1.1" status: 204 len: 173 time: 1.2345915 May 26 14:46:13.806477 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-0f5ba026-15bb-4b4a-977f-c08f17bad3af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:13.806477 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-0f5ba026-15bb-4b4a-977f-c08f17bad3af service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2292099 May 26 14:46:13.847974 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.853636 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.857475 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e2836723-2beb-4f60-b65f-a6ec0d7ec8e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:13.896118 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1133} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:46:13.906697 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64c1268a-f654-4e14-ae1b-bd51c9de792c,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:13.909949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:13.914067 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.914905 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Added segment dbc923bc-953d-4379-ac99-a42c93117401 of type vlan for network 149051aa-2259-48fd-9599-39a44ad33762 May 26 14:46:13.944682 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.981677 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-0c65da28-12e9-4109-94af-1d59a108d679 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1687334 May 26 14:46:13.983898 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:13.985177 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:13.986049 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:14.009578 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f84889c2-4550-4f20-8a01-17cc66e67e19 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:14.030508 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6547387 May 26 14:46:14.032658 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 42988) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:14.041960 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Request body: {'subnet': {'network_id': '149051aa-2259-48fd-9599-39a44ad33762', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1369650357-subnet', 'tenant_id': 'd1a7192ff14647f894360c51e8ceac5b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:46:14.046568 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:14.051051 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Usage tracker for resource:subnet and tenant:d1a7192ff14647f894360c51e8ceac5b is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:14.054515 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:14.062099 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:14.135371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Made reservation on behalf of d1a7192ff14647f894360c51e8ceac5b for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:46:14.137918 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2577413'] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:14.142428 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-36cc2308-c1f1-49f2-8307-b9c34db8e8c0 req-7a5137c8-ea1d-49c2-8384-bf3b8a1c4189 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1532431 May 26 14:46:14.153086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6fae069-4b34-4e39-b7d2-d6557ea6519d', 'name': 'network-vif-deleted', 'tag': '07c99fe4-b739-48a8-b269-6578cdfef012'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:14.203430 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c6fae069-4b34-4e39-b7d2-d6557ea6519d', 'name': 'network-vif-deleted', 'tag': '07c99fe4-b739-48a8-b269-6578cdfef012', 'status': 'completed', 'code': 200} May 26 14:46:14.261949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Pushing event updated for resources: {'Network': ['ID=149051aa-2259-48fd-9599-39a44ad33762,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:14.267160 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:14.273141 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 149051aa-2259-48fd-9599-39a44ad33762 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:46:14.327752 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eee25a2-d4cf-47cc-9822-8fb45d382c5c req-41b0e8e4-f85d-496d-9dc6-21866f634f16 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:14.329251 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2eee25a2-d4cf-47cc-9822-8fb45d382c5c req-41b0e8e4-f85d-496d-9dc6-21866f634f16 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.2072213 May 26 14:46:14.430573 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2eee25a2-d4cf-47cc-9822-8fb45d382c5c req-dc1ed62b-6584-4f39-89fc-be21e7d9b6d9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0930710 May 26 14:46:14.682295 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7e119bd2-8566-4017-96ef-2e806f58c8b8 req-e08debc5-21f4-4fdf-ab46-f8400a0dfae8 tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6fae069-4b34-4e39-b7d2-d6557ea6519d HTTP/1.1" status: 200 len: 210 time: 0.0485756 May 26 14:46:14.692177 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2332857', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2577427'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:14.696604 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6f73c55c-2ee2-4a60-aa54-4e51b239b278 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:14.765896 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 6edfff02-2e00-4da7-8c08-37a887f1f08f no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:46:14.774004 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7943e8a1-ce31-4420-87bb-233f0b2070de,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:14.778622 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:14.788147 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Checking segment: {'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:46:14.788516 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Network hostable DHCP agents. Network: 149051aa-2259-48fd-9599-39a44ad33762, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:46:14.805444 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 6edfff02-2e00-4da7-8c08-37a887f1f08f {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:46:14.805829 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 6edfff02-2e00-4da7-8c08-37a887f1f08f not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:46:14.808907 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Network 149051aa-2259-48fd-9599-39a44ad33762 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:46:14.820371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 149051aa-2259-48fd-9599-39a44ad33762) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:46:14.829832 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-648071bb-4c3c-4265-bb12-7c5ba0de3289 None None] Network 149051aa-2259-48fd-9599-39a44ad33762 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:46:14.834155 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:14.834995 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:14.857372 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8250904 May 26 14:46:14.974068 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e845a3e9-821c-44a9-833b-9bc62b66d5ab req-e040cdf1-dd7a-40bd-a4fe-df2fc9386412 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:14.975725 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e845a3e9-821c-44a9-833b-9bc62b66d5ab req-e040cdf1-dd7a-40bd-a4fe-df2fc9386412 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 945 time: 0.0814648 May 26 14:46:15.027195 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e845a3e9-821c-44a9-833b-9bc62b66d5ab req-04ed142a-1b0d-4192-a753-ad062432d01c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445583 May 26 14:46:15.031491 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a66c1dd3-1568-49f4-8264-6f633a72a948 None None] Network 149051aa-2259-48fd-9599-39a44ad33762 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:46:15.517719 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b765aaec-c124-441a-b762-b1a128a41952 req-cbfe8302-9dc3-4e61-9eb8-9c4321f9129e tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:15.519161 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-b765aaec-c124-441a-b762-b1a128a41952 req-cbfe8302-9dc3-4e61-9eb8-9c4321f9129e tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Synchronizing usage tracker for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:46:15.541168 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-b765aaec-c124-441a-b762-b1a128a41952 req-cbfe8302-9dc3-4e61-9eb8-9c4321f9129e tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Unset dirty status for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:46:15.542954 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b765aaec-c124-441a-b762-b1a128a41952 req-cbfe8302-9dc3-4e61-9eb8-9c4321f9129e tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 945 time: 0.1175725 May 26 14:46:15.662883 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7ee29c-f60f-4eb7-84e6-1dd1c648a547 req-5dc593f2-6919-4247-bbab-255b4c7c69ea tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:15.664560 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a7ee29c-f60f-4eb7-84e6-1dd1c648a547 req-5dc593f2-6919-4247-bbab-255b4c7c69ea tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.0952697 May 26 14:46:15.716138 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a7ee29c-f60f-4eb7-84e6-1dd1c648a547 req-f1d6c226-517c-4a9f-93a4-58b79e6a699d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450187 May 26 14:46:15.742287 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Deleting port c15a8128-db77-479e-9b42-25276139f049 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:46:15.742287 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:15.871807 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] For port c15a8128-db77-479e-9b42-25276139f049, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=c15a8128-db77-479e-9b42-25276139f049,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:15.872163 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:16.000796 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Calling delete_port for c15a8128-db77-479e-9b42-25276139f049 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:46:16.121840 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:16.128256 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:16.168546 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ec4ee3ea-9d36-4c14-a225-a3445629295c', 'c15a8128-db77-479e-9b42-25276139f049'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:46:16.178252 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Pushing event deleted for resources: {'Port': ['ID=c15a8128-db77-479e-9b42-25276139f049,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:16.181941 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:16.253526 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f48fb66a-c097-4aba-b470-4286f6af7c23 req-87221ba7-e674-446a-b56f-9a9948616f33 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=45acbebb-b7dd-48a6-89ee-c5e0b057813f HTTP/1.1" status: 200 len: 210 time: 0.1009669 May 26 14:46:16.266705 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] No DVR routers for this DVR port c15a8128-db77-479e-9b42-25276139f049 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:46:16.277486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:16.277486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45acbebb-b7dd-48a6-89ee-c5e0b057813f', 'name': 'network-vif-deleted', 'tag': 'c15a8128-db77-479e-9b42-25276139f049'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:16.292191 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-b765aaec-c124-441a-b762-b1a128a41952 req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "DELETE /v2.0/ports/c15a8128-db77-479e-9b42-25276139f049 HTTP/1.1" status: 204 len: 173 time: 0.7399299 May 26 14:46:16.347459 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45acbebb-b7dd-48a6-89ee-c5e0b057813f', 'name': 'network-vif-deleted', 'tag': 'c15a8128-db77-479e-9b42-25276139f049', 'status': 'completed', 'code': 200} May 26 14:46:16.758353 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 07c99fe4-b739-48a8-b269-6578cdfef012 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:46:16.806737 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 07c99fe4-b739-48a8-b269-6578cdfef012 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:46:16.807229 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 07c99fe4-b739-48a8-b269-6578cdfef012 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:46:16.808289 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:46:17.004196 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:17.039198 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:17.058965 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:17.066219 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:17.071153 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:17.178766 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=8']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:17.187577 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.188287 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.188814 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.189300 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.189849 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.190441 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.191036 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.191568 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.192074 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.192611 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.193172 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.193873 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:17.199412 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:17.229789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43144) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:17.234681 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6c5ab6-81f0-4948-ab8e-3ef793cd70bf req-1a0144ea-aadb-4942-801e-495db2dfdd36 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:17.236751 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3b6c5ab6-81f0-4948-ab8e-3ef793cd70bf req-1a0144ea-aadb-4942-801e-495db2dfdd36 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 946 time: 0.3967805 May 26 14:46:17.245954 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-e88ca521-946e-44c7-9f74-850fb927f08b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:17.246657 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-e88ca521-946e-44c7-9f74-850fb927f08b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Synchronizing usage tracker for tenant:d1a7192ff14647f894360c51e8ceac5b on resource:network {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:46:17.295060 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-e88ca521-946e-44c7-9f74-850fb927f08b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Unset dirty status for tenant:d1a7192ff14647f894360c51e8ceac5b on resource:network {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:46:17.296210 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-e88ca521-946e-44c7-9f74-850fb927f08b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/networks?id=149051aa-2259-48fd-9599-39a44ad33762 HTTP/1.1" status: 200 len: 814 time: 0.2929475 May 26 14:46:17.317334 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3b6c5ab6-81f0-4948-ab8e-3ef793cd70bf req-ea797473-3a87-430e-a2a4-84bffaacb440 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0663488 May 26 14:46:17.326445 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-ca33b5fd-1bc6-4889-8bcb-5ad58f67316e tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/quotas/d1a7192ff14647f894360c51e8ceac5b HTTP/1.1" status: 200 len: 375 time: 0.0243769 May 26 14:46:17.407335 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-e840c706-65fa-417a-854f-642cb77a27cc tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=d1a7192ff14647f894360c51e8ceac5b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0799127 May 26 14:46:17.417759 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'code': 200} May 26 14:46:17.445464 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:17.492855 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:17.500359 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Usage tracker for resource:security_group_rule and tenant:8684554c72fd4deb9e6ea2e4c9e91c51 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:17.504963 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:17.519137 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:17.633374 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-13b37c38-036f-4a43-a711-f5facb7f998a service neutron] 10.222.0.72 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2250786 May 26 14:46:17.684509 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:17.692000 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:17.710621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-15d76ac2-70fe-4632-8669-95f790cde1b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:17.752127 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1faeb4f-96f7-466d-9b2a-d8ee2521f364,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:17.757872 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:17.783091 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=8684554c72fd4deb9e6ea2e4c9e91c51&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5520406 May 26 14:46:17.784086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43194) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:17.852920 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8305401a-7bcf-467b-bb47-8dddfdda8dd0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:17.885919 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8305401a-7bcf-467b-bb47-8dddfdda8dd0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:17.894594 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-08e11363-286e-480d-a6f0-dfad3d6d0636 service neutron] 10.222.0.72 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2584691 May 26 14:46:17.977733 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8305401a-7bcf-467b-bb47-8dddfdda8dd0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:17.982821 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a6d801ea-947d-40f6-99c3-201a80c9f4c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:18.010601 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8305401a-7bcf-467b-bb47-8dddfdda8dd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1faeb4f-96f7-466d-9b2a-d8ee2521f364,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:18.017281 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8305401a-7bcf-467b-bb47-8dddfdda8dd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:18.024936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8305401a-7bcf-467b-bb47-8dddfdda8dd0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:18.026593 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8305401a-7bcf-467b-bb47-8dddfdda8dd0 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/f1faeb4f-96f7-466d-9b2a-d8ee2521f364 HTTP/1.1" status: 204 len: 168 time: 0.2411950 May 26 14:46:18.151791 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dc865b97-f8df-4937-849b-e3f68df72d2a req-1cecea5b-d70e-46c3-8c66-4e9f93423aa2 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 210 time: 0.0631847 May 26 14:46:18.915638 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac5e0b5-fa84-48c3-87ff-dda7093824af req-cd700367-aaac-4786-867b-b1cc119b7169 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:18.917979 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3ac5e0b5-fa84-48c3-87ff-dda7093824af req-cd700367-aaac-4786-867b-b1cc119b7169 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1141469 May 26 14:46:18.986919 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3ac5e0b5-fa84-48c3-87ff-dda7093824af req-999d851c-c492-43e3-ac9a-378f67c27d25 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609524 May 26 14:46:19.448351 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4b31d436-dd3f-4db3-a3fe-252ff33ec647 req-25ee9c35-c354-47ef-a43d-149dbc53f929 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 210 time: 0.0720575 May 26 14:46:19.712730 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43358) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:19.776695 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a17e4c-b4a1-4ebf-ae0f-d8c23ee86a01 req-5483a3ed-de25-46d8-82d4-6aaffb8cfd30 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:19.778495 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-90a17e4c-b4a1-4ebf-ae0f-d8c23ee86a01 req-5483a3ed-de25-46d8-82d4-6aaffb8cfd30 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 945 time: 0.1690741 May 26 14:46:19.846294 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-90a17e4c-b4a1-4ebf-ae0f-d8c23ee86a01 req-11536a0d-091f-41d9-9621-9c528b651ce4 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584617 May 26 14:46:20.133124 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-7405def4-0bbe-4c6f-ad0d-49c37dbcaeba service neutron] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.4186928 May 26 14:46:20.175495 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-a928e1dd-febc-4d0d-b912-708387902e15 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:20.177526 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-a928e1dd-febc-4d0d-b912-708387902e15 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.79 "GET /v2.0/networks?id=149051aa-2259-48fd-9599-39a44ad33762 HTTP/1.1" status: 200 len: 814 time: 0.4078321 May 26 14:46:20.226038 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Request body: {'port': {'device_id': '1aa656c9-a4aa-48ee-94a5-04c967e50d67', 'network_id': '149051aa-2259-48fd-9599-39a44ad33762', 'admin_state_up': True, 'tenant_id': 'd1a7192ff14647f894360c51e8ceac5b'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:46:20.288485 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9749d87b-57c9-41f1-92da-4ae50ecc2460 req-e2c613b7-022d-4b9a-9114-b290d4b712e5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:20.290678 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9749d87b-57c9-41f1-92da-4ae50ecc2460 req-e2c613b7-022d-4b9a-9114-b290d4b712e5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1102233 May 26 14:46:20.354846 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9749d87b-57c9-41f1-92da-4ae50ecc2460 req-f63b4b2d-f30c-48d2-9fc8-9594f8c12da9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0576413 May 26 14:46:20.406612 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:20.411208 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Usage tracker for resource:port and tenant:d1a7192ff14647f894360c51e8ceac5b is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:20.414393 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:20.420257 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:20.431603 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Made reservation on behalf of d1a7192ff14647f894360c51e8ceac5b for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:46:20.435884 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:20.629455 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6993d293-6c1d-4ded-b92f-e4704ad5b55a req-b43b0b87-afce-45f6-a930-e3998ba64bc1 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 210 time: 0.0504119 May 26 14:46:20.640745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Allocated IP 172.20.0.11 (149051aa-2259-48fd-9599-39a44ad33762/7943e8a1-ce31-4420-87bb-233f0b2070de/5134882e-952e-454a-8d3a-826458d3d6bb) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:46:20.802636 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device c15a8128-db77-479e-9b42-25276139f049 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:46:20.837275 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: c15a8128-db77-479e-9b42-25276139f049 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:46:20.837617 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device c15a8128-db77-479e-9b42-25276139f049 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:46:20.838104 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:46:20.856981 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:20.891111 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:20.899021 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-70df5501-c514-4438-840c-41044ac8bd38 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:20.968135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Network 149051aa-2259-48fd-9599-39a44ad33762 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:46:20.973603 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:46:20.978138 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:46:21.040714 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Pushing event updated for resources: {'Port': ['ID=5134882e-952e-454a-8d3a-826458d3d6bb,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:21.045717 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:21.057587 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:21.058498 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:21.090024 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8752184 May 26 14:46:21.112918 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c7fbda-99b2-4fe4-b0a2-d106af0013a0 req-e6de50bc-4bb4-4b49-a4ce-3c3c3b244c44 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:21.114561 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-34c7fbda-99b2-4fe4-b0a2-d106af0013a0 req-e6de50bc-4bb4-4b49-a4ce-3c3c3b244c44 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 945 time: 0.1170542 May 26 14:46:21.117376 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Request body: {'port': {'device_id': '1aa656c9-a4aa-48ee-94a5-04c967e50d67', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:46:21.166890 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-34c7fbda-99b2-4fe4-b0a2-d106af0013a0 req-7776fd9b-06f1-4c1e-941d-91e606934a5f tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463903 May 26 14:46:21.232619 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:21.628733 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bcfca85-486c-4beb-a6e6-2beb06b39c72 req-359bedaf-36d4-4c84-8ade-39bbd2fb3407 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:21.631754 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccd7762-1304-4e02-9087-99b29c886411 req-c5775a66-5ddd-433e-9ef7-2ff74fc78a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:21.632779 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-98fd1f0e-7afb-46e5-8f13-c0005a36cab8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:21.633466 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-2ccd7762-1304-4e02-9087-99b29c886411 req-c5775a66-5ddd-433e-9ef7-2ff74fc78a71 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1098 time: 0.1404989 May 26 14:46:21.636727 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bcfca85-486c-4beb-a6e6-2beb06b39c72 req-359bedaf-36d4-4c84-8ade-39bbd2fb3407 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1207485 May 26 14:46:21.672929 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dabb8646-a2d5-4f26-bce3-93f612aae7bc req-efba5aff-7ad1-49df-a1b0-8157083850b5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:21.674931 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dabb8646-a2d5-4f26-bce3-93f612aae7bc req-efba5aff-7ad1-49df-a1b0-8157083850b5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1997325 May 26 14:46:21.727449 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bcfca85-486c-4beb-a6e6-2beb06b39c72 req-2cc4d3d0-8720-482f-91f4-2718344ffafa tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0898430 May 26 14:46:21.759662 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dabb8646-a2d5-4f26-bce3-93f612aae7bc req-a668193a-e96a-40b7-8ee5-8e104c13137e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0754187 May 26 14:46:21.775541 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5134882e-952e-454a-8d3a-826458d3d6bb {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:46:21.783915 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:21.813091 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Transition to ACTIVE for port object 5134882e-952e-454a-8d3a-826458d3d6bb will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:46:21.819032 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:21.825364 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7bcd171a-6534-4f39-a509-aec1261a70fa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:21.983027 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Pushing event updated for resources: {'Port': ['ID=5134882e-952e-454a-8d3a-826458d3d6bb,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:21.988172 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:21.989687 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccd7762-1304-4e02-9087-99b29c886411 req-b0ed6778-d504-4d4c-82e7-aa966dd30f1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:21.991482 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-2ccd7762-1304-4e02-9087-99b29c886411 req-b0ed6778-d504-4d4c-82e7-aa966dd30f1d service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.3142221 May 26 14:46:22.025545 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d67fb48-6762-4bce-b55e-278f4c0a7120 req-1eed9fd6-0d2d-4479-9b34-89ba6e139b7f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:22.027122 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6d67fb48-6762-4bce-b55e-278f4c0a7120 req-1eed9fd6-0d2d-4479-9b34-89ba6e139b7f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 944 time: 0.1801274 May 26 14:46:22.039819 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-80a6e0b5-652a-4438-ab0f-afdda88d7f92 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:22.041366 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-80a6e0b5-652a-4438-ab0f-afdda88d7f92 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 945 time: 0.1252797 May 26 14:46:22.135936 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-6d67fb48-6762-4bce-b55e-278f4c0a7120 req-d6013598-c564-4696-b227-cef37a87b1a5 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Synchronizing usage tracker for tenant:d1a7192ff14647f894360c51e8ceac5b on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:46:22.154340 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43434) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:22.220051 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-6d67fb48-6762-4bce-b55e-278f4c0a7120 req-d6013598-c564-4696-b227-cef37a87b1a5 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Unset dirty status for tenant:d1a7192ff14647f894360c51e8ceac5b on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:46:22.221697 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6d67fb48-6762-4bce-b55e-278f4c0a7120 req-d6013598-c564-4696-b227-cef37a87b1a5 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1794255 May 26 14:46:22.233867 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-2ccd7762-1304-4e02-9087-99b29c886411 req-b9426978-dbb2-410f-b819-cc76e3520f95 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 200 len: 217 time: 0.2016242 May 26 14:46:22.242786 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Deleting port ec4ee3ea-9d36-4c14-a225-a3445629295c {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:46:22.243109 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.272583 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Attempting to bind port 5134882e-952e-454a-8d3a-826458d3d6bb on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:46:22.274879 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Attempting to bind port 5134882e-952e-454a-8d3a-826458d3d6bb by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:46:22.275443 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Attempting to bind port 5134882e-952e-454a-8d3a-826458d3d6bb on network 149051aa-2259-48fd-9599-39a44ad33762 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:46:22.283629 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Port 5134882e-952e-454a-8d3a-826458d3d6bb on network 149051aa-2259-48fd-9599-39a44ad33762 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:46:22.284522 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Attempting to bind port 5134882e-952e-454a-8d3a-826458d3d6bb on network 149051aa-2259-48fd-9599-39a44ad33762 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:46:22.292164 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 45, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:46:22.292496 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Checking segment: {'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:46:22.293060 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Bound using segment: {'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:46:22.293499 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Bound port: 5134882e-952e-454a-8d3a-826458d3d6bb, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:46:22.293998 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.386861 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] For port 5134882e-952e-454a-8d3a-826458d3d6bb, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:46:22.389872 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] For port 5134882e-952e-454a-8d3a-826458d3d6bb, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=5134882e-952e-454a-8d3a-826458d3d6bb,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:46:22.394560 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.398218 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:22.459418 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:22.460030 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.461403 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] 10.222.0.79 "PUT /v2.0/ports/5134882e-952e-454a-8d3a-826458d3d6bb HTTP/1.1" status: 200 len: 1094 time: 1.3489227 May 26 14:46:22.461899 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1aa656c9-a4aa-48ee-94a5-04c967e50d67', 'tag': '5134882e-952e-454a-8d3a-826458d3d6bb'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:22.479101 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Pushing event updated for resources: {'Port': ['ID=5134882e-952e-454a-8d3a-826458d3d6bb,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:22.490008 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:22.510423 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1aa656c9-a4aa-48ee-94a5-04c967e50d67', 'tag': '5134882e-952e-454a-8d3a-826458d3d6bb', 'status': 'completed', 'code': 200} May 26 14:46:22.549566 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-a4fd70b5-baa4-46c8-a519-8f439553e015 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=8756a7c99bc647a39be9c326450af98a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3650165 May 26 14:46:22.552078 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43446) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:22.576440 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] For port ec4ee3ea-9d36-4c14-a225-a3445629295c, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ec4ee3ea-9d36-4c14-a225-a3445629295c,segment=NetworkSegment(663227a3-9a48-4112-a25f-e542d7087a84),segment_id=663227a3-9a48-4112-a25f-e542d7087a84)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:22.576788 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.611308 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-32f93360-2ecb-4d94-84c7-280bafd02590 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.637193 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-32f93360-2ecb-4d94-84c7-280bafd02590 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.691409 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-32f93360-2ecb-4d94-84c7-280bafd02590 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.696521 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-236f2499-cfce-4fab-9556-3fa61de9533a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:22.702169 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb0bc364-980b-48fa-98bc-e9a5ee2ef833 req-12cc78a4-57ee-4ce9-b422-a605247b84f9 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:22.703683 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cb0bc364-980b-48fa-98bc-e9a5ee2ef833 req-12cc78a4-57ee-4ce9-b422-a605247b84f9 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 945 time: 0.3484476 May 26 14:46:22.711028 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Calling delete_port for ec4ee3ea-9d36-4c14-a225-a3445629295c owned by compute:nova {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:46:22.714242 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f93360-2ecb-4d94-84c7-280bafd02590 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=471f38f4-1786-4c47-8539-c40e07a726ae,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:22.716795 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-32f93360-2ecb-4d94-84c7-280bafd02590 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:22.726072 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-32f93360-2ecb-4d94-84c7-280bafd02590 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.729855 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-32f93360-2ecb-4d94-84c7-280bafd02590 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/471f38f4-1786-4c47-8539-c40e07a726ae HTTP/1.1" status: 204 len: 168 time: 0.1741631 May 26 14:46:22.768595 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cb0bc364-980b-48fa-98bc-e9a5ee2ef833 req-e2035710-58b2-44a3-b008-01109f09745d tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/security-groups?id=6654faba-95a7-41f7-8376-aad28218a94c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545681 May 26 14:46:22.971393 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:22.983817 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:23.043948 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Pushing event deleted for resources: {'Port': ['ID=ec4ee3ea-9d36-4c14-a225-a3445629295c,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:23.072596 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:23.127815 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] No DVR routers for this DVR port ec4ee3ea-9d36-4c14-a225-a3445629295c on host hv-cinder-77459 {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:46:23.133483 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:23.137283 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75dff9cc-3473-4c96-8f63-78fe18c37cd3', 'name': 'network-vif-deleted', 'tag': 'ec4ee3ea-9d36-4c14-a225-a3445629295c'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:23.154350 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4557be59-3adf-4580-b7ed-7dea829c729c req-c9272563-accf-463d-9cc8-207e534babdd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:23.155801 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4557be59-3adf-4580-b7ed-7dea829c729c req-c9272563-accf-463d-9cc8-207e534babdd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.2996790 May 26 14:46:23.162477 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ed2cc21a-b3a7-4e56-8421-1317d8ee8233 req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.79 "DELETE /v2.0/ports/ec4ee3ea-9d36-4c14-a225-a3445629295c HTTP/1.1" status: 204 len: 173 time: 1.0850940 May 26 14:46:23.186779 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91df037e-d84d-4f82-9d31-5b59de2d16b2 req-aadf3e3f-fcc9-44db-a0ab-81adc78cd573 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:23.188191 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-91df037e-d84d-4f82-9d31-5b59de2d16b2 req-aadf3e3f-fcc9-44db-a0ab-81adc78cd573 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.2915626 May 26 14:46:23.236147 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4557be59-3adf-4580-b7ed-7dea829c729c req-3066a7f1-114c-4bc5-b953-188ee1149da6 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727406 May 26 14:46:23.248060 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-91df037e-d84d-4f82-9d31-5b59de2d16b2 req-86b060e4-d03d-49bb-8156-35e406aba70f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0540302 May 26 14:46:23.277297 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a3e29fef-a1d4-40a7-bada-8c538fec55c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:23.295429 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75dff9cc-3473-4c96-8f63-78fe18c37cd3', 'name': 'network-vif-deleted', 'tag': 'ec4ee3ea-9d36-4c14-a225-a3445629295c', 'status': 'completed', 'code': 200} May 26 14:46:23.427258 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7674dd6b-6a50-4d2d-ad2f-4cd8f09f34eb req-4d9d2825-759d-4fbc-bc5f-8c8801cdbe11 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:23.428762 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7674dd6b-6a50-4d2d-ad2f-4cd8f09f34eb req-4d9d2825-759d-4fbc-bc5f-8c8801cdbe11 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 944 time: 0.0824511 May 26 14:46:23.481556 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7674dd6b-6a50-4d2d-ad2f-4cd8f09f34eb req-5ab4270f-832e-4fbf-8524-65e73d730366 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444257 May 26 14:46:23.846042 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:23.927436 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-8006a768-22d5-40ba-a5b6-7e7e80cbab1a req-c4538795-2a78-4927-801a-d89ecc801c08 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Synchronizing usage tracker for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:46:23.947198 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-8006a768-22d5-40ba-a5b6-7e7e80cbab1a req-c4538795-2a78-4927-801a-d89ecc801c08 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Unset dirty status for tenant:3159eb22d2eb468e967fa04761ae0331 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:46:23.949007 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8006a768-22d5-40ba-a5b6-7e7e80cbab1a req-c4538795-2a78-4927-801a-d89ecc801c08 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 210 time: 0.0636384 May 26 14:46:24.488379 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a00a5a4-0859-4830-acee-2baf1ed56733 req-a987eb0d-7f0c-4745-8280-3ff45b632ca7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:24.489844 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4a00a5a4-0859-4830-acee-2baf1ed56733 req-a987eb0d-7f0c-4745-8280-3ff45b632ca7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1400087 May 26 14:46:24.500961 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5271b7e8-f50a-467d-a239-6bdef61db103 req-f6bf8e30-5b2e-49ef-9626-74f1e60b911a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:24.502327 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5271b7e8-f50a-467d-a239-6bdef61db103 req-f6bf8e30-5b2e-49ef-9626-74f1e60b911a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1187916 May 26 14:46:24.555603 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:24.575446 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4a00a5a4-0859-4830-acee-2baf1ed56733 req-ab70d665-4931-4082-8a45-2a137e61102c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722153 May 26 14:46:24.582423 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5271b7e8-f50a-467d-a239-6bdef61db103 req-3fe74e26-299e-4892-8f1d-35f5346fd946 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0660191 May 26 14:46:24.760628 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaddeeff-9332-443a-9f81-51f14fd51ee5 req-83c4a18f-ff95-47ec-9ad5-0dc0a59a6d3f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:24.761965 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aaddeeff-9332-443a-9f81-51f14fd51ee5 req-83c4a18f-ff95-47ec-9ad5-0dc0a59a6d3f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 944 time: 0.0871913 May 26 14:46:24.805979 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aaddeeff-9332-443a-9f81-51f14fd51ee5 req-6552caf4-566b-4c10-96f6-79b18cd556e6 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382559 May 26 14:46:24.820797 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ec4ee3ea-9d36-4c14-a225-a3445629295c'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:46:24.954759 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccd7762-1304-4e02-9087-99b29c886411 req-9ec44c64-e8e3-4782-8441-978e3e0cfb27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:24.956220 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-2ccd7762-1304-4e02-9087-99b29c886411 req-9ec44c64-e8e3-4782-8441-978e3e0cfb27 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.0615051 May 26 14:46:24.968120 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5731ce90-1105-4fc3-89f7-4b4e6bc3fd9b req-506275b0-1944-42a1-926a-4115dbdab24b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:24.969631 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5731ce90-1105-4fc3-89f7-4b4e6bc3fd9b req-506275b0-1944-42a1-926a-4115dbdab24b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=d1a7192ff14647f894360c51e8ceac5b&device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 1097 time: 0.0728641 May 26 14:46:25.038013 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-2ccd7762-1304-4e02-9087-99b29c886411 req-30e88f1d-e05f-4549-852f-0fbfc4497b65 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0424528 May 26 14:46:25.145172 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4ec5370c-6c7e-4ce1-8129-dec9d93d535a req-320a95e6-c689-4fbd-9e43-89f66455381c tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] 10.222.0.72 "GET /v2.0/ports?device_id=75dff9cc-3473-4c96-8f63-78fe18c37cd3 HTTP/1.1" status: 200 len: 210 time: 0.0569232 May 26 14:46:25.198784 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-2ccd7762-1304-4e02-9087-99b29c886411 req-4da0e916-c26b-4f13-a177-94213fe7ae5d service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1507597 May 26 14:46:25.209115 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5731ce90-1105-4fc3-89f7-4b4e6bc3fd9b req-bcbe3216-73c8-4e21-a6ae-174fa289bcd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:25.210621 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5731ce90-1105-4fc3-89f7-4b4e6bc3fd9b req-bcbe3216-73c8-4e21-a6ae-174fa289bcd3 service neutron] 10.222.0.79 "GET /v2.0/networks?tenant_id=d1a7192ff14647f894360c51e8ceac5b&shared=False HTTP/1.1" status: 200 len: 916 time: 0.2128472 May 26 14:46:25.335182 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-2ccd7762-1304-4e02-9087-99b29c886411 req-dc8ab121-64b6-43e4-a4ef-214f76f983ca service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1294932 May 26 14:46:25.432730 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5731ce90-1105-4fc3-89f7-4b4e6bc3fd9b req-5156871b-a586-42b0-900c-cac75e256ef1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:25.434204 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5731ce90-1105-4fc3-89f7-4b4e6bc3fd9b req-5156871b-a586-42b0-900c-cac75e256ef1 service neutron] 10.222.0.79 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.2146599 May 26 14:46:25.692545 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-54e4af3e-4316-4dfd-b7ef-bfa58b696e76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:25.695157 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-54e4af3e-4316-4dfd-b7ef-bfa58b696e76 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=d1a7192ff14647f894360c51e8ceac5b&device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 1097 time: 0.1070225 May 26 14:46:25.717012 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-9b2db4ec-1ad2-47b1-816c-ebd13ed7079b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:25.718545 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-9b2db4ec-1ad2-47b1-816c-ebd13ed7079b service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364&tenant_id=f2b58b2245f643ac9193934fdab405c5 HTTP/1.1" status: 200 len: 1097 time: 0.0841219 May 26 14:46:25.827510 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-f54ef33a-b272-4182-ae3d-c6e82c0983dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:25.829123 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-f54ef33a-b272-4182-ae3d-c6e82c0983dd service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 1097 time: 0.0708508 May 26 14:46:25.841243 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-ea40ca6f-88b4-45ce-aeac-699acda5ec45 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=5134882e-952e-454a-8d3a-826458d3d6bb HTTP/1.1" status: 200 len: 217 time: 0.1110024 May 26 14:46:25.889573 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:25.936897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-179ca45c-cd09-4b18-999c-23db51ff417f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:25.938924 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-179ca45c-cd09-4b18-999c-23db51ff417f service neutron] 10.222.0.79 "GET /v2.0/subnets?id=7943e8a1-ce31-4420-87bb-233f0b2070de HTTP/1.1" status: 200 len: 854 time: 0.0868826 May 26 14:46:25.975832 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-2600d711-649b-42ca-856d-9f6793c58529 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:25.977321 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-2600d711-649b-42ca-856d-9f6793c58529 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1381440 May 26 14:46:26.005135 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6177ce67-f449-4f66-bf29-834a41e052d4 req-7ad8dbc3-9240-45b4-a2e2-2557b3a06c2a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:26.012236 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6177ce67-f449-4f66-bf29-834a41e052d4 req-7ad8dbc3-9240-45b4-a2e2-2557b3a06c2a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.3160117 May 26 14:46:26.017107 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-6df54730-5e66-4f72-8aef-70bdf9ce697d service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=149051aa-2259-48fd-9599-39a44ad33762&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0698659 May 26 14:46:26.036279 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83d1e1d-4fbe-43ca-ac18-b4e2caf18fe7 req-faabe884-4b9d-405d-b107-8661e51e53df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:26.037748 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e83d1e1d-4fbe-43ca-ac18-b4e2caf18fe7 req-faabe884-4b9d-405d-b107-8661e51e53df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.3087087 May 26 14:46:26.115824 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-690f3628-a0a2-473a-9672-2fd22b297897 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23 HTTP/1.1" status: 200 len: 999 time: 0.1307714 May 26 14:46:26.119258 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6177ce67-f449-4f66-bf29-834a41e052d4 req-c70bf88f-7d5e-4243-8dac-a69622ffc6e9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1057417 May 26 14:46:26.206959 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-efa35c6d-9048-4414-8d98-6cba17cf9a6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:26.208493 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-efa35c6d-9048-4414-8d98-6cba17cf9a6d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0869820 May 26 14:46:26.224965 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e83d1e1d-4fbe-43ca-ac18-b4e2caf18fe7 req-679dfda4-e79d-4ab5-af13-fe83c7ef70f3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1775205 May 26 14:46:26.268645 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-c81cc9a3-b79f-49d4-96a2-19925754ec5e service neutron] 10.222.0.79 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2182109 May 26 14:46:26.323663 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-eb2ccea7-4bfe-4e06-be94-af56b9398b68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:26.325720 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-eb2ccea7-4bfe-4e06-be94-af56b9398b68 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1090171 May 26 14:46:26.343941 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43500) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:26.469559 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-56fd1eaa-eb1c-4902-ae74-8fa25abc0288 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1335809 May 26 14:46:26.488162 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_v2 [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Deleting subnet e482f08e-dc41-4d58-b9cf-6de9798b0585 {{(pid=98445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:46:26.494074 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:26.555696 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-41aa9eb9-90ee-49b5-a6b3-59cfb3077cec service neutron] 10.222.0.79 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2506924 May 26 14:46:26.570230 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe25e5d9-5c79-41e6-ba81-aa777bcc9a71 req-99a74da5-5ed8-491a-83a1-2e078d6c7f89 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:26.571808 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fe25e5d9-5c79-41e6-ba81-aa777bcc9a71 req-99a74da5-5ed8-491a-83a1-2e078d6c7f89 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 944 time: 0.3022997 May 26 14:46:26.574213 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2677826'] for subnet, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:26.667838 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fe25e5d9-5c79-41e6-ba81-aa777bcc9a71 req-877bcf38-d09f-4c0f-ae03-0c33a35efac2 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630193 May 26 14:46:26.668764 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:26.696423 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a90053f4-4f3f-4990-acc6-be02e7c2027a req-cc192ed0-a466-494d-bc67-70a147f1ee80 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2177875 May 26 14:46:26.928902 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2332920', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2577448'] for subnet, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:26.932938 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:26.968249 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e482f08e-dc41-4d58-b9cf-6de9798b0585,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:26.971391 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:26.972339 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:26.978519 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/e482f08e-dc41-4d58-b9cf-6de9798b0585 HTTP/1.1" status: 204 len: 168 time: 0.6335235 May 26 14:46:26.981248 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43512) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:27.183220 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:27.368424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:27.422089 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c6d63b53-7bae-4cfb-ac0b-4643c0894395']}} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:46:27.460396 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '663227a3-9a48-4112-a25f-e542d7087a84') {'for_net_delete': True} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:46:27.461648 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '663227a3-9a48-4112-a25f-e542d7087a84') {} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:46:27.464951 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:27.493274 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2677883'] for segment, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:27.528029 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3691ff-ca8e-4530-a83f-cb46e0217887 req-0267a00e-632a-4b70-9a4d-ebaa2efd9b4f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:27.535147 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3e3691ff-ca8e-4530-a83f-cb46e0217887 req-0267a00e-632a-4b70-9a4d-ebaa2efd9b4f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.2433543 May 26 14:46:27.538469 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:27.565575 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Releasing vlan 1145 on physical network physnet1 to pool {{(pid=98445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:46:27.565978 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2334298'] for segment, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: Traceback (most recent call last): May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: timer() May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: cb(*args, **kw) May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: return func(*args, **kwargs) May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: self._notify() May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: self.callback(batched_events) May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: event.method(event) May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: return f(self, *a, **k) May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._get(url).json() May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: return self.request(url, 'GET', **kwargs) May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:46:27.582397 dv-cinder-774594-6-iscsi neutron-server[98445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:46:27.693103 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb3033ad-a9ab-4885-a612-547629610349 req-d07600bd-8554-4cdf-9719-c386aff7494f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:27.702062 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb3033ad-a9ab-4885-a612-547629610349 req-d07600bd-8554-4cdf-9719-c386aff7494f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.3234086 May 26 14:46:27.710469 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3e3691ff-ca8e-4530-a83f-cb46e0217887 req-c45b7a7f-4c95-485d-9526-352fba9dfeab tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1744461 May 26 14:46:27.734012 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:27.736378 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:27.757526 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:27.772804 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Pushing event deleted for resources: {'Network': ['ID=c6d63b53-7bae-4cfb-ac0b-4643c0894395,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:27.785649 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:27.799187 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9fdba421-4291-44a5-8bf5-16658687d0fd admin admin] 10.222.0.72 "DELETE /v2.0/networks/c6d63b53-7bae-4cfb-ac0b-4643c0894395 HTTP/1.1" status: 204 len: 168 time: 0.8145080 May 26 14:46:27.802664 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb3033ad-a9ab-4885-a612-547629610349 req-5bf4edfd-9d5f-47c9-b2b7-20660246c6a5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0992742 May 26 14:46:27.854886 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device ec4ee3ea-9d36-4c14-a225-a3445629295c no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:46:27.899716 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: ec4ee3ea-9d36-4c14-a225-a3445629295c {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:46:27.900395 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device ec4ee3ea-9d36-4c14-a225-a3445629295c not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:46:27.963872 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2a0c00-e4fb-4abd-9241-1491ae626277 req-56c8b43f-8562-4d58-81b8-9cd1cf04da60 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:27.965737 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0a2a0c00-e4fb-4abd-9241-1491ae626277 req-56c8b43f-8562-4d58-81b8-9cd1cf04da60 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 944 time: 0.1015363 May 26 14:46:28.015252 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0a2a0c00-e4fb-4abd-9241-1491ae626277 req-07f7c914-95e6-42b9-9857-7ffbfe6136e0 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412295 May 26 14:46:28.050874 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43542) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:28.102967 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-799faf66-a07d-4ef7-9523-d73ec9533051 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=3159eb22d2eb468e967fa04761ae0331&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0505352 May 26 14:46:28.105250 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43546) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:28.170050 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-97829840-be9c-44a7-86ef-e4ff01416a9e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:28.198158 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-97829840-be9c-44a7-86ef-e4ff01416a9e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:28.255687 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-97829840-be9c-44a7-86ef-e4ff01416a9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:28.259633 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5e88ded0-ca70-4ba6-b9f2-bc90be3c883d tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:28.273248 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97829840-be9c-44a7-86ef-e4ff01416a9e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6654faba-95a7-41f7-8376-aad28218a94c,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:28.276288 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-97829840-be9c-44a7-86ef-e4ff01416a9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:28.278292 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-97829840-be9c-44a7-86ef-e4ff01416a9e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:28.281844 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-97829840-be9c-44a7-86ef-e4ff01416a9e admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/6654faba-95a7-41f7-8376-aad28218a94c HTTP/1.1" status: 204 len: 168 time: 0.1732264 May 26 14:46:28.784550 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43568) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:29.069907 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ab3f32-f020-49cb-a09a-e6cc8f287e42 req-8346133d-7079-431e-8d5a-0b32a8b74755 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:29.073877 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-57ab3f32-f020-49cb-a09a-e6cc8f287e42 req-8346133d-7079-431e-8d5a-0b32a8b74755 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.2336433 May 26 14:46:29.125017 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:29.144260 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:29.149380 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Usage tracker for resource:security_group_rule and tenant:01d7328956db45cabb5723850cc9240a is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:29.153110 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:29.160549 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:29.169129 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-57ab3f32-f020-49cb-a09a-e6cc8f287e42 req-10b8c467-3140-47c7-afba-85b347bc0e14 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911896 May 26 14:46:29.178287 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485917fd-438a-4d53-b91d-aa52688e61f8 req-48ec89be-95e4-4afa-bde3-604b454fdff6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:29.185709 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-485917fd-438a-4d53-b91d-aa52688e61f8 req-48ec89be-95e4-4afa-bde3-604b454fdff6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.2258325 May 26 14:46:29.279025 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-485917fd-438a-4d53-b91d-aa52688e61f8 req-0e8b7fbe-e0e3-498d-8684-bb9e2a4478c5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0835495 May 26 14:46:29.394237 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:29.409108 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:29.419352 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-461dc2f7-ec05-4465-aab9-082dcf08e84a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:29.432410 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cce818-b1fb-428a-b1b1-87abab77e664 req-d6482626-8602-4aa0-a030-38fab72be124 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:29.433890 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e4cce818-b1fb-428a-b1b1-87abab77e664 req-d6482626-8602-4aa0-a030-38fab72be124 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 944 time: 0.1336710 May 26 14:46:29.460915 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=01d7328956db45cabb5723850cc9240a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6750624 May 26 14:46:29.463388 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43588) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:29.476303 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=038f9fb5-5a89-4656-ba95-a2ae2b802ad6,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:29.489460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:29.500241 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e4cce818-b1fb-428a-b1b1-87abab77e664 req-42741b52-baa7-4665-9e12-6561abd53b49 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596073 May 26 14:46:29.557189 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-482b4edd-0518-416c-851b-a6605b51de01 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:29.595304 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-482b4edd-0518-416c-851b-a6605b51de01 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:29.656155 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-482b4edd-0518-416c-851b-a6605b51de01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:29.661725 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b4130db8-1164-4adc-bf91-18b77ccbd794 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:29.676842 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-482b4edd-0518-416c-851b-a6605b51de01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=038f9fb5-5a89-4656-ba95-a2ae2b802ad6,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:29.684334 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-482b4edd-0518-416c-851b-a6605b51de01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:29.686657 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-482b4edd-0518-416c-851b-a6605b51de01 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:29.690444 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-482b4edd-0518-416c-851b-a6605b51de01 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/038f9fb5-5a89-4656-ba95-a2ae2b802ad6 HTTP/1.1" status: 204 len: 168 time: 0.2233963 May 26 14:46:29.858963 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 5134882e-952e-454a-8d3a-826458d3d6bb details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:46:30.081466 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 5134882e-952e-454a-8d3a-826458d3d6bb, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=5134882e-952e-454a-8d3a-826458d3d6bb,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:30.118332 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '5134882e-952e-454a-8d3a-826458d3d6bb', 'network_id': '149051aa-2259-48fd-9599-39a44ad33762', 'port_id': '5134882e-952e-454a-8d3a-826458d3d6bb', 'mac_address': 'fa:16:3e:ff:79:b6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7943e8a1-ce31-4420-87bb-233f0b2070de', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:46:30.198159 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:30.217695 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5134882e-952e-454a-8d3a-826458d3d6bb {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:46:30.234505 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 5134882e-952e-454a-8d3a-826458d3d6bb, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=5134882e-952e-454a-8d3a-826458d3d6bb,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:30.239131 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:30.240971 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:30.367289 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=5134882e-952e-454a-8d3a-826458d3d6bb,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:30.379260 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:30.417634 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6b7e26a-556c-44f9-95d1-0feac4574f31 req-b362f424-bcc3-4a09-9474-e11f305e2d48 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:30.419167 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d6b7e26a-556c-44f9-95d1-0feac4574f31 req-b362f424-bcc3-4a09-9474-e11f305e2d48 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1042273 May 26 14:46:30.520269 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d6b7e26a-556c-44f9-95d1-0feac4574f31 req-ae79d078-6933-4a83-8e31-67f36f3f728b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938964 May 26 14:46:30.590883 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03d8716-3761-4851-af87-e7858aa4152f req-f77b1f94-9344-42bf-bbe6-c7eee5b9babc tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:30.592205 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e03d8716-3761-4851-af87-e7858aa4152f req-f77b1f94-9344-42bf-bbe6-c7eee5b9babc tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1426442 May 26 14:46:30.647586 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['5134882e-952e-454a-8d3a-826458d3d6bb'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:46:30.660937 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e03d8716-3761-4851-af87-e7858aa4152f req-b80d26d9-270f-45e6-b152-a5ada8a0a723 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609410 May 26 14:46:30.816716 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d33f970-ad1a-4318-bf3d-3e2ffd5e168a req-82b5656d-32bf-4bef-9b79-130d9e6b57ba tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:30.823002 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6d33f970-ad1a-4318-bf3d-3e2ffd5e168a req-82b5656d-32bf-4bef-9b79-130d9e6b57ba tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 945 time: 0.1506004 May 26 14:46:30.872516 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6d33f970-ad1a-4318-bf3d-3e2ffd5e168a req-c141c8f4-575b-4731-be17-0bf20e0e6dfb tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485356 May 26 14:46:31.055173 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43630) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:31.190568 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:31.205591 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:31.209691 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Usage tracker for resource:security_group_rule and tenant:2a37f1b2dd584fb29cda7e6a14585ade is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:31.212524 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:31.218623 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:31.313365 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:31.318567 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:31.326284 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f0716c87-9a18-4740-ba58-629854d15336 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:31.369145 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e3256de-379f-4856-9ee3-c52df80ad757,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:31.376062 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=2a37f1b2dd584fb29cda7e6a14585ade&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3172920 May 26 14:46:31.376062 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:31.376364 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43636) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:31.444478 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-acfdaef9-0afd-48e6-9e42-b67cefa3e2b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:31.473551 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-acfdaef9-0afd-48e6-9e42-b67cefa3e2b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:31.536063 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-acfdaef9-0afd-48e6-9e42-b67cefa3e2b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:31.540325 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-24ccf045-6679-4697-92b6-e321868bb055 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:31.555200 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acfdaef9-0afd-48e6-9e42-b67cefa3e2b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e3256de-379f-4856-9ee3-c52df80ad757,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:31.558362 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-acfdaef9-0afd-48e6-9e42-b67cefa3e2b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:31.560554 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-acfdaef9-0afd-48e6-9e42-b67cefa3e2b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:31.564203 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-acfdaef9-0afd-48e6-9e42-b67cefa3e2b0 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9e3256de-379f-4856-9ee3-c52df80ad757 HTTP/1.1" status: 204 len: 168 time: 0.1845772 May 26 14:46:31.756927 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-019a5606-5c1c-4d03-8ee2-0cfe1d5840c5 req-fa3552b1-0576-469c-9bcf-01e8712fa6cb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:31.758515 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-019a5606-5c1c-4d03-8ee2-0cfe1d5840c5 req-fa3552b1-0576-469c-9bcf-01e8712fa6cb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1021383 May 26 14:46:31.879659 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 5134882e-952e-454a-8d3a-826458d3d6bb up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:46:31.994752 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-019a5606-5c1c-4d03-8ee2-0cfe1d5840c5 req-685d9dc3-37a1-46d7-a337-b6d3f4fac12e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2296374 May 26 14:46:32.030658 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6a2c2a-1405-4fde-8fac-38a041a0997b req-5c2593ee-03b9-4cc9-ac85-38983e245b2c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:32.032192 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ea6a2c2a-1405-4fde-8fac-38a041a0997b req-5c2593ee-03b9-4cc9-ac85-38983e245b2c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.2442639 May 26 14:46:32.038958 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 5134882e-952e-454a-8d3a-826458d3d6bb completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:46:32.044266 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 5134882e-952e-454a-8d3a-826458d3d6bb triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:46:32.044875 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.073415 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43650) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:32.107537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.124517 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ea6a2c2a-1405-4fde-8fac-38a041a0997b req-de4984d3-a830-43b2-ad08-be234b4b2beb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0837867 May 26 14:46:32.147505 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:32.167311 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Usage tracker for resource:security_group_rule and tenant:68a45a57bce747779b6c73c2919c6a83 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:32.171014 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:32.178018 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:32.282659 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.311932 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.333739 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.341841 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e33b8765-6c6a-4e11-bbde-505eeadbb396 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:32.361217 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 5134882e-952e-454a-8d3a-826458d3d6bb, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=5134882e-952e-454a-8d3a-826458d3d6bb,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:32.363091 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1aa656c9-a4aa-48ee-94a5-04c967e50d67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5134882e-952e-454a-8d3a-826458d3d6bb'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:32.370186 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.372293 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:32.389648 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea591dd-0186-4c69-a60f-8e8b363ea6a6 req-e6458b23-3085-4658-a94f-2c3fe8fbe33d tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:32.398994 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cea591dd-0186-4c69-a60f-8e8b363ea6a6 req-e6458b23-3085-4658-a94f-2c3fe8fbe33d tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 945 time: 0.2303345 May 26 14:46:32.403765 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f46a3678-5b03-40a4-a442-257a3412dac8,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:32.407347 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:32.440091 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1aa656c9-a4aa-48ee-94a5-04c967e50d67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5134882e-952e-454a-8d3a-826458d3d6bb', 'code': 200} May 26 14:46:32.461694 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=68a45a57bce747779b6c73c2919c6a83&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3809710 May 26 14:46:32.473465 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43656) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:32.486887 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cea591dd-0186-4c69-a60f-8e8b363ea6a6 req-0f31bad3-f361-47fa-9723-b0e58eac0da6 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0868611 May 26 14:46:32.509810 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=5134882e-952e-454a-8d3a-826458d3d6bb,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:32.516773 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:32.590142 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7614f0ef-160b-40ff-876f-416ce7fbbc1e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.617282 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7614f0ef-160b-40ff-876f-416ce7fbbc1e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.677282 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7614f0ef-160b-40ff-876f-416ce7fbbc1e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.681308 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9e9309ca-f7f0-470b-ad3e-cf4a5356b73f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:32.692749 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7614f0ef-160b-40ff-876f-416ce7fbbc1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f46a3678-5b03-40a4-a442-257a3412dac8,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:32.696929 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7614f0ef-160b-40ff-876f-416ce7fbbc1e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:32.701033 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7614f0ef-160b-40ff-876f-416ce7fbbc1e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:32.702148 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7614f0ef-160b-40ff-876f-416ce7fbbc1e admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/f46a3678-5b03-40a4-a442-257a3412dac8 HTTP/1.1" status: 204 len: 168 time: 0.2226183 May 26 14:46:33.236166 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0cac24c-1aee-4954-99d9-04ab2705fe65 req-782e5371-9a6d-4197-8ca5-910973821ddd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:33.238329 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e0cac24c-1aee-4954-99d9-04ab2705fe65 req-782e5371-9a6d-4197-8ca5-910973821ddd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1107726 May 26 14:46:33.342188 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e0cac24c-1aee-4954-99d9-04ab2705fe65 req-9832a38c-fcab-4cec-b111-9ec10004395f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0975246 May 26 14:46:33.407075 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ec0216-ee3c-4f9f-89fe-956b033d0e2c req-18118531-1055-478a-8a83-62569b86c06f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:33.408712 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b0ec0216-ee3c-4f9f-89fe-956b033d0e2c req-18118531-1055-478a-8a83-62569b86c06f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1334863 May 26 14:46:33.467034 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b0ec0216-ee3c-4f9f-89fe-956b033d0e2c req-1ed0486b-e876-4566-878a-aac6332b30d0 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0524957 May 26 14:46:33.707027 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c24e4f-eab9-4aad-8897-32400f189c93 req-a89f57ff-fcaa-47c9-8384-d6c125915faa tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:33.708518 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4c24e4f-eab9-4aad-8897-32400f189c93 req-a89f57ff-fcaa-47c9-8384-d6c125915faa tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0860591 May 26 14:46:33.758100 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4c24e4f-eab9-4aad-8897-32400f189c93 req-fb39f453-ba7a-4c74-92ad-59d1f0b6208d tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434134 May 26 14:46:34.569660 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a8da8e-80f1-474a-8097-fefe3151a8b6 req-64378524-0810-4259-82ca-a5608e5b4c73 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:34.571266 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-74a8da8e-80f1-474a-8097-fefe3151a8b6 req-64378524-0810-4259-82ca-a5608e5b4c73 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1159620 May 26 14:46:34.675943 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-74a8da8e-80f1-474a-8097-fefe3151a8b6 req-39ddbc80-66b1-4de6-bec6-2b5bd86bb409 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0980105 May 26 14:46:34.723344 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b4950b-aab7-4073-af53-069d63563571 req-cf791114-a831-4b85-b4d0-181d632aacd6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:34.724906 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c8b4950b-aab7-4073-af53-069d63563571 req-cf791114-a831-4b85-b4d0-181d632aacd6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1168649 May 26 14:46:34.778490 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c8b4950b-aab7-4073-af53-069d63563571 req-6b7b5261-fca7-4116-9c7a-da2bb1507478 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474992 May 26 14:46:34.985136 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58ae034-d841-4aea-9946-b9e95adb0faf req-eb6d9fc4-cc8e-4544-91be-1f3a609b3fb1 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:34.987179 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f58ae034-d841-4aea-9946-b9e95adb0faf req-eb6d9fc4-cc8e-4544-91be-1f3a609b3fb1 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0919383 May 26 14:46:35.045589 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f58ae034-d841-4aea-9946-b9e95adb0faf req-d12f1d5d-c3b5-4dc1-bc87-6d4159ab7514 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507917 May 26 14:46:35.887294 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c94bf22-15c2-4639-9060-6ca3e7f06dc5 req-17d79e02-a1ae-40c5-b18b-c869fb55459d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:35.889034 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c94bf22-15c2-4639-9060-6ca3e7f06dc5 req-17d79e02-a1ae-40c5-b18b-c869fb55459d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0990214 May 26 14:46:35.989252 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c94bf22-15c2-4639-9060-6ca3e7f06dc5 req-1e4440f5-306d-4904-9600-681eaf5ef3d8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0945272 May 26 14:46:36.018277 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ccbee5-293d-4c4e-bfca-99ac5a7696fc req-1f2f11f5-5d50-4fdf-9943-53a6f6dc1f55 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:36.019815 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-88ccbee5-293d-4c4e-bfca-99ac5a7696fc req-1f2f11f5-5d50-4fdf-9943-53a6f6dc1f55 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1240413 May 26 14:46:36.092872 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-88ccbee5-293d-4c4e-bfca-99ac5a7696fc req-d0de49c8-fd7e-4ee3-a8a0-b99d9c9da499 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0666769 May 26 14:46:36.261573 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93d8444-753b-43b8-8b86-fd5ef1c82405 req-f15c9239-de29-4448-9705-5d7ae78c3ec9 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:36.263145 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f93d8444-753b-43b8-8b86-fd5ef1c82405 req-f15c9239-de29-4448-9705-5d7ae78c3ec9 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0874045 May 26 14:46:36.310512 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f93d8444-753b-43b8-8b86-fd5ef1c82405 req-4f1d9cf5-2f63-488d-b402-5988045cf3f1 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416942 May 26 14:46:37.217111 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d76930-3df7-40f9-ae65-eb65733bad99 req-73786a9a-a187-4121-bf70-630f6a2a6b34 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:37.217111 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b7d76930-3df7-40f9-ae65-eb65733bad99 req-73786a9a-a187-4121-bf70-630f6a2a6b34 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1084955 May 26 14:46:37.308250 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b7d76930-3df7-40f9-ae65-eb65733bad99 req-768a83ee-33d4-4527-86e5-a5eeef069c0d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0833015 May 26 14:46:37.346404 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b422abea-6d5c-42bc-b5ea-5e36c4b164c7 req-d11701c2-7eac-47c3-add7-7f7de291e54e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:37.348059 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b422abea-6d5c-42bc-b5ea-5e36c4b164c7 req-d11701c2-7eac-47c3-add7-7f7de291e54e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.0943484 May 26 14:46:37.398907 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b422abea-6d5c-42bc-b5ea-5e36c4b164c7 req-372ed130-bb09-4535-a8ae-cfe9059cd7f1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437839 May 26 14:46:37.536264 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f685ddf5-4ee2-4388-9175-5ef648c72348 req-36c5d818-6c5c-490f-8a27-2e287a4c09dc tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:37.537832 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f685ddf5-4ee2-4388-9175-5ef648c72348 req-36c5d818-6c5c-490f-8a27-2e287a4c09dc tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0897624 May 26 14:46:37.585874 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f685ddf5-4ee2-4388-9175-5ef648c72348 req-f197936a-9cf4-4e7c-b586-a14446745cec tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420523 May 26 14:46:38.514356 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768665f3-0d03-4e5b-8119-b544f3b582bb req-b0d6565d-af5c-4feb-87bf-6e49dffb8952 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:38.515887 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-768665f3-0d03-4e5b-8119-b544f3b582bb req-b0d6565d-af5c-4feb-87bf-6e49dffb8952 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0924447 May 26 14:46:38.627716 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-768665f3-0d03-4e5b-8119-b544f3b582bb req-20c5377a-28c2-4b73-8abf-45cc0a51046c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0978267 May 26 14:46:38.658612 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-688d4951-37f5-4a3c-8310-a7dcfa1287f6 req-b994eb63-de84-458a-8699-faa56fec7489 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:38.660332 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-688d4951-37f5-4a3c-8310-a7dcfa1287f6 req-b994eb63-de84-458a-8699-faa56fec7489 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1159883 May 26 14:46:38.709931 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-688d4951-37f5-4a3c-8310-a7dcfa1287f6 req-15095c97-f4ae-4496-8108-262a4b23b44a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431299 May 26 14:46:38.816238 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3144f81f-8807-4fbc-9209-e19d4ae17d28 req-e85a7e53-a247-4feb-9789-a927fc952ac2 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:38.817703 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3144f81f-8807-4fbc-9209-e19d4ae17d28 req-e85a7e53-a247-4feb-9789-a927fc952ac2 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0909631 May 26 14:46:38.864313 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3144f81f-8807-4fbc-9209-e19d4ae17d28 req-3b331f50-adb6-4cbd-928b-1008c236fec6 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406284 May 26 14:46:39.812402 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89726d0e-87f0-4ec2-9f66-2afe2ec1ea1e req-39dfa873-ae2c-4d09-b4c5-e87aa669d9e7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:39.813866 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-89726d0e-87f0-4ec2-9f66-2afe2ec1ea1e req-39dfa873-ae2c-4d09-b4c5-e87aa669d9e7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0805130 May 26 14:46:39.985776 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-89726d0e-87f0-4ec2-9f66-2afe2ec1ea1e req-7abe917c-7c4b-4888-b64a-8029387db3ac tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1652074 May 26 14:46:40.009376 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8526bc0-6184-45da-9ff8-c3fc60b81df2 req-d0bd231e-809b-428c-af88-32d6f6c6af14 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:40.010889 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f8526bc0-6184-45da-9ff8-c3fc60b81df2 req-d0bd231e-809b-428c-af88-32d6f6c6af14 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1921403 May 26 14:46:40.055871 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f8526bc0-6184-45da-9ff8-c3fc60b81df2 req-6741a7a4-20bb-4fde-b736-cca82927b055 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391822 May 26 14:46:40.175772 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c5973d-ea1c-41f9-82af-034a1a5fb392 req-46d6164c-fb90-4cbf-96f0-0dd1a85e0a0c tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:40.177224 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-87c5973d-ea1c-41f9-82af-034a1a5fb392 req-46d6164c-fb90-4cbf-96f0-0dd1a85e0a0c tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0919967 May 26 14:46:40.221678 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-87c5973d-ea1c-41f9-82af-034a1a5fb392 req-080a2d79-6ea9-48d7-b5f9-c37fd67d56f0 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385754 May 26 14:46:41.218227 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:46:41.234259 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d11d936-15e2-40b0-8ebb-161bab4d47b5 req-e3260aef-a480-426c-b9d3-585b7b8649d8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:41.235783 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7d11d936-15e2-40b0-8ebb-161bab4d47b5 req-e3260aef-a480-426c-b9d3-585b7b8649d8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1314163 May 26 14:46:41.289848 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7d11d936-15e2-40b0-8ebb-161bab4d47b5 req-ceeb5c6e-dd70-410b-966b-e6ee3b61674c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482254 May 26 14:46:41.299939 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06395af0-77ed-4642-8049-761c9fbd1e32 req-126447fb-0744-429e-a8e7-252474d21630 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:41.301346 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06395af0-77ed-4642-8049-761c9fbd1e32 req-126447fb-0744-429e-a8e7-252474d21630 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1330729 May 26 14:46:41.346894 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06395af0-77ed-4642-8049-761c9fbd1e32 req-1aa55482-5585-4776-a601-9a3151ab1d9f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396709 May 26 14:46:41.468865 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b86af6a0-e221-4c31-9bae-1945dbfc6fde req-8af4f924-c710-4e19-b024-e90a640978c1 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:41.470335 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b86af6a0-e221-4c31-9bae-1945dbfc6fde req-8af4f924-c710-4e19-b024-e90a640978c1 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0846350 May 26 14:46:41.518636 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b86af6a0-e221-4c31-9bae-1945dbfc6fde req-76b2ee4d-60b8-44ef-8735-fb2f20020641 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399060 May 26 14:46:42.115653 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e819ce-db79-4429-a89b-bafdd7bb3672 req-05e50281-8f22-4062-9dc2-64bb9b115682 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:42.117161 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-15e819ce-db79-4429-a89b-bafdd7bb3672 req-05e50281-8f22-4062-9dc2-64bb9b115682 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 1099 time: 0.0825288 May 26 14:46:42.164977 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-15e819ce-db79-4429-a89b-bafdd7bb3672 req-9aeda7be-77cb-408a-969c-54014f459851 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356910 May 26 14:46:42.543982 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2411e4-2937-48bf-8d01-6f5619af18c9 req-be2b0fc1-d50e-4b04-9758-86f6310d185a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:42.545506 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f2411e4-2937-48bf-8d01-6f5619af18c9 req-be2b0fc1-d50e-4b04-9758-86f6310d185a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1385715 May 26 14:46:42.581643 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d4a8ae-f32d-40d1-8dcd-abea6a94eb14 req-0ba91cfe-f4e7-4b44-b9f5-f387b8d6c285 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:42.583092 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b4d4a8ae-f32d-40d1-8dcd-abea6a94eb14 req-0ba91cfe-f4e7-4b44-b9f5-f387b8d6c285 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1232760 May 26 14:46:42.619931 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f2411e4-2937-48bf-8d01-6f5619af18c9 req-808b1c8a-1ff4-4fbd-bd4d-1451b67eebda tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677338 May 26 14:46:42.643155 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b4d4a8ae-f32d-40d1-8dcd-abea6a94eb14 req-18f4550e-2a98-41de-ac68-a77bf9da97de tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515966 May 26 14:46:42.813876 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5333d9af-cc3e-4ea9-abbf-e6b25987f641 req-8794d334-6294-4d82-8d11-1aaf05585a5e tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:42.815341 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5333d9af-cc3e-4ea9-abbf-e6b25987f641 req-8794d334-6294-4d82-8d11-1aaf05585a5e tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0901639 May 26 14:46:42.861256 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5333d9af-cc3e-4ea9-abbf-e6b25987f641 req-c530d73b-6d49-4dbb-b05b-3ad62b797827 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400965 May 26 14:46:43.861161 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd5e058-c9dd-4834-93e2-38072edba85e req-80682dee-9f48-4631-9384-89a9e02388f7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:43.862639 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4bd5e058-c9dd-4834-93e2-38072edba85e req-80682dee-9f48-4631-9384-89a9e02388f7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1365786 May 26 14:46:43.872882 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88e98a02-92a6-4656-8e78-0dcbe22e914a req-8c03cc2b-cf10-47e8-b339-c9adfd99eae9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:43.874268 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-88e98a02-92a6-4656-8e78-0dcbe22e914a req-8c03cc2b-cf10-47e8-b339-c9adfd99eae9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1176333 May 26 14:46:43.941000 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4bd5e058-c9dd-4834-93e2-38072edba85e req-68b7c9b5-f400-4ae9-ad7b-2ceeaddf33c8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657997 May 26 14:46:43.945323 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-88e98a02-92a6-4656-8e78-0dcbe22e914a req-ad84c226-c41d-4f3e-a226-eabff5aa9f30 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574067 May 26 14:46:44.124888 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91324636-39b4-4f0c-9edd-50fa5501f6f5 req-be192df2-d89d-4618-b681-a128a15774fa tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:44.126427 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-91324636-39b4-4f0c-9edd-50fa5501f6f5 req-be192df2-d89d-4618-b681-a128a15774fa tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0830326 May 26 14:46:44.170376 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-91324636-39b4-4f0c-9edd-50fa5501f6f5 req-6548a46e-64e7-4634-bceb-d05e39a72d39 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379694 May 26 14:46:45.193565 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398a9a59-9b6b-41ea-a3ca-43d673ca30dd req-be507ae5-f811-410e-9bce-5cded5728d3a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:45.195198 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-398a9a59-9b6b-41ea-a3ca-43d673ca30dd req-be507ae5-f811-410e-9bce-5cded5728d3a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1448493 May 26 14:46:45.203275 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-620e4e48-c969-45f6-8a25-0acedeafd84a req-50819524-7f6e-484f-89ea-cd7f179463f3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:45.204949 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-620e4e48-c969-45f6-8a25-0acedeafd84a req-50819524-7f6e-484f-89ea-cd7f179463f3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1217959 May 26 14:46:45.270629 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-398a9a59-9b6b-41ea-a3ca-43d673ca30dd req-1eb754bb-8832-4fa4-9a49-a1c2b8fd27c7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647035 May 26 14:46:45.277905 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-620e4e48-c969-45f6-8a25-0acedeafd84a req-1b232943-09ab-4ba3-8d3b-6d8ed88917e9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588987 May 26 14:46:45.639852 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9448c386-afbd-4be1-abc4-f79be844df03 req-593fe7b4-371e-4070-9d53-556220b8fd43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:45.640522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe53244b-b915-4f49-9d81-357c1484aceb req-fcf9cadd-42fe-4838-a1a6-c87ce2e3bf6e tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:45.641493 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9448c386-afbd-4be1-abc4-f79be844df03 req-593fe7b4-371e-4070-9d53-556220b8fd43 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3defae92a9a1480c9278cae3445f9617&device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1137 time: 0.0766203 May 26 14:46:45.641666 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fe53244b-b915-4f49-9d81-357c1484aceb req-fcf9cadd-42fe-4838-a1a6-c87ce2e3bf6e tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0902767 May 26 14:46:45.691719 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fe53244b-b915-4f49-9d81-357c1484aceb req-586df784-a1d9-4edc-bc4b-1f1607a6e1a8 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0435047 May 26 14:46:45.785452 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9448c386-afbd-4be1-abc4-f79be844df03 req-a6c9272c-f12a-465d-8020-468ab08d1bc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:45.786937 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9448c386-afbd-4be1-abc4-f79be844df03 req-a6c9272c-f12a-465d-8020-468ab08d1bc3 service neutron] 10.222.0.79 "GET /v2.0/networks?id=f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 200 len: 917 time: 0.1379452 May 26 14:46:45.903288 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9448c386-afbd-4be1-abc4-f79be844df03 req-8dd70ba6-12ad-4207-8ef5-7457e855ef61 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 1001 time: 0.0998704 May 26 14:46:45.966936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9448c386-afbd-4be1-abc4-f79be844df03 req-01d09647-a07e-4faf-9875-94b2c3a093c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:45.968341 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9448c386-afbd-4be1-abc4-f79be844df03 req-01d09647-a07e-4faf-9875-94b2c3a093c1 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=466228a3-069c-4ecc-9790-37e83a8604c9 HTTP/1.1" status: 200 len: 854 time: 0.0574436 May 26 14:46:46.055922 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9448c386-afbd-4be1-abc4-f79be844df03 req-dcee98bf-4884-45fb-b1eb-42f352e2df6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:46.057399 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9448c386-afbd-4be1-abc4-f79be844df03 req-dcee98bf-4884-45fb-b1eb-42f352e2df6b service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=f37261a9-5fa8-47e1-88e3-772578212058&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0747759 May 26 14:46:46.195108 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9448c386-afbd-4be1-abc4-f79be844df03 req-78243ddd-6fd1-4331-b604-58439deeb90c service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1305087 May 26 14:46:46.337326 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9448c386-afbd-4be1-abc4-f79be844df03 req-0c551e77-372a-4817-852f-9f3822826880 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1347311 May 26 14:46:46.536400 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738256d4-3afb-4398-a372-e4e106f636a6 req-d7eb120a-0183-4957-8242-38a40fccdd2c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:46.537966 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-738256d4-3afb-4398-a372-e4e106f636a6 req-d7eb120a-0183-4957-8242-38a40fccdd2c tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1451495 May 26 14:46:46.557107 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0546eff6-99d1-42d2-a8ca-cdf0d9107fb0 req-1170b7f5-3d06-4037-8d8a-ad647ea810b5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:46.558545 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0546eff6-99d1-42d2-a8ca-cdf0d9107fb0 req-1170b7f5-3d06-4037-8d8a-ad647ea810b5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1265159 May 26 14:46:46.569222 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43930) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:46.624819 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-738256d4-3afb-4398-a372-e4e106f636a6 req-7f008f40-68f1-4e5e-ae43-dd422215d14b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763464 May 26 14:46:46.632146 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0546eff6-99d1-42d2-a8ca-cdf0d9107fb0 req-1d8c4468-aee0-4931-bd7b-08715c70f3b9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0611620 May 26 14:46:46.704473 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:46.719097 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:46.723096 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Usage tracker for resource:security_group_rule and tenant:aaf34036aeb24c34a51101b2cc38a934 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:46.726492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:46.733856 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:46.815358 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:46.820724 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:46.827960 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5895d47f-f111-4b7e-a0ef-92451a88b38a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:46.868102 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=aaf34036aeb24c34a51101b2cc38a934&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2977445 May 26 14:46:46.869123 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec8e7704-481a-4079-b1f5-9b384acfddaa,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:46.871123 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43938) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:46.872501 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:47.028282 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d9988b-9e2b-43fa-af4c-10340c57eccb req-a55a84bb-1cfc-4e2d-ae77-ade2b0848d3a tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:47.029814 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-74d9988b-9e2b-43fa-af4c-10340c57eccb req-a55a84bb-1cfc-4e2d-ae77-ade2b0848d3a tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.2135198 May 26 14:46:47.060193 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.109725 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-74d9988b-9e2b-43fa-af4c-10340c57eccb req-71cffacf-05b1-4623-8dcb-10158df7aa2a tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0719712 May 26 14:46:47.114140 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.173855 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.177815 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9a75deb9-c8f6-495b-8985-2765b8474cca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:47.189270 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec8e7704-481a-4079-b1f5-9b384acfddaa,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:47.199650 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.200020 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.200386 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.200739 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.201089 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.201437 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.201802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.202123 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.202505 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.202855 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.203199 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.203534 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:46:47.206893 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.208042 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/ec8e7704-481a-4079-b1f5-9b384acfddaa HTTP/1.1" status: 204 len: 168 time: 0.3357239 May 26 14:46:47.209107 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:47.504449 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 43950) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:47.526901 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.543693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:47.548131 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Usage tracker for resource:security_group_rule and tenant:9b94bdb49c154832a349e6509d47b867 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:47.551628 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:47.557688 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:47.650335 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.655333 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.664177 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-85db4551-b675-4cc9-9dfd-3b2c2004b60f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:47.694194 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=68189d8f-b2d6-4139-b39b-39170201751c,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:47.698653 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:47.720260 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 43958) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:47.720852 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=9b94bdb49c154832a349e6509d47b867&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2147086 May 26 14:46:47.883794 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2ec90b74-993a-4e2b-a352-aac327bc5558 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.929181 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2ec90b74-993a-4e2b-a352-aac327bc5558 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:47.963247 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5285a9ab-877a-4fc3-934c-ab2d35cffbb6 req-cc4e61ac-aeea-469a-ab69-a079cc64bf5a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:47.964714 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5285a9ab-877a-4fc3-934c-ab2d35cffbb6 req-cc4e61ac-aeea-469a-ab69-a079cc64bf5a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.2143948 May 26 14:46:47.985279 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ff71f1-d332-4439-bebc-b6eaf8383456 req-0d6c32a6-4613-44f0-947b-fc5e811b93de tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:47.986723 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-57ff71f1-d332-4439-bebc-b6eaf8383456 req-0d6c32a6-4613-44f0-947b-fc5e811b93de tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1949849 May 26 14:46:48.062903 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5285a9ab-877a-4fc3-934c-ab2d35cffbb6 req-02123b7c-abc8-4853-8556-6a9ea46b7e12 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892982 May 26 14:46:48.072857 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-57ff71f1-d332-4439-bebc-b6eaf8383456 req-0172e627-2570-4341-a48d-130e4f18397a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0706999 May 26 14:46:48.074251 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2ec90b74-993a-4e2b-a352-aac327bc5558 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:48.079225 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:48.091240 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec90b74-993a-4e2b-a352-aac327bc5558 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=68189d8f-b2d6-4139-b39b-39170201751c,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:48.095006 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-2ec90b74-993a-4e2b-a352-aac327bc5558 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:48.098474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2ec90b74-993a-4e2b-a352-aac327bc5558 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:48.101997 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-2ec90b74-993a-4e2b-a352-aac327bc5558 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/68189d8f-b2d6-4139-b39b-39170201751c HTTP/1.1" status: 204 len: 168 time: 0.3783014 May 26 14:46:48.301714 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06e55eb3-7f83-4163-a24b-75f9ce725358 req-c8717e6f-cbe1-417e-94b3-0c3cd4cab382 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:48.303323 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06e55eb3-7f83-4163-a24b-75f9ce725358 req-c8717e6f-cbe1-417e-94b3-0c3cd4cab382 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0861452 May 26 14:46:48.354856 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06e55eb3-7f83-4163-a24b-75f9ce725358 req-297026e4-b822-4d6b-ba25-569ab886ddbc tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0432677 May 26 14:46:49.374424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffefe42c-c04a-462f-b450-05feb790a299 req-64e7f484-857c-4e53-85f2-87af8881d1b7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:49.375894 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ffefe42c-c04a-462f-b450-05feb790a299 req-64e7f484-857c-4e53-85f2-87af8881d1b7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1476555 May 26 14:46:49.384397 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc91db1-d669-4dd9-a7d0-4e36062c07f5 req-20bd2eee-7f38-4ca4-89e7-5136c0156773 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:49.386052 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-edc91db1-d669-4dd9-a7d0-4e36062c07f5 req-20bd2eee-7f38-4ca4-89e7-5136c0156773 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 944 time: 0.1253054 May 26 14:46:49.456619 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ffefe42c-c04a-462f-b450-05feb790a299 req-9f6fd5d6-9a76-4cae-aca4-f7c286c24759 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698752 May 26 14:46:49.461440 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-edc91db1-d669-4dd9-a7d0-4e36062c07f5 req-5c5da9d1-66f6-46ad-b8da-ce382e255f48 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0617340 May 26 14:46:49.643506 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9311d008-f899-4ad7-8876-a63502387a3d req-7e23c24a-e15d-497d-9925-08883528e7f3 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:49.644962 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9311d008-f899-4ad7-8876-a63502387a3d req-7e23c24a-e15d-497d-9925-08883528e7f3 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0876443 May 26 14:46:49.692038 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9311d008-f899-4ad7-8876-a63502387a3d req-23ba5253-ae03-4e44-a1b1-11fb643319bf tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0412445 May 26 14:46:49.944930 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:46:50.091974 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:50.107104 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'port_id': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'mac_address': 'fa:16:3e:1e:15:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:46:50.179667 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:50.203454 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8553a1c9-db24-4d4f-8d37-0a358f73ac23 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:46:50.224438 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:50.236983 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:50.239130 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-1aeef2b8-dce1-4bc1-9f24-7b48f65cd53e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:50.319975 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=9']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:50.323316 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:50.734451 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65c29472-652e-44c5-a6ed-73bc91c62c61 req-42d13b8d-f77b-4ee5-82a7-d8480278686a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:50.735915 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-65c29472-652e-44c5-a6ed-73bc91c62c61 req-42d13b8d-f77b-4ee5-82a7-d8480278686a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 945 time: 0.1522717 May 26 14:46:50.746199 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ff1a74-6469-496f-8ce9-610b560b5b81 req-827bba1e-c964-424a-89dc-bc89a78082b5 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:50.747623 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-45ff1a74-6469-496f-8ce9-610b560b5b81 req-827bba1e-c964-424a-89dc-bc89a78082b5 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1268744 May 26 14:46:50.768005 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['8553a1c9-db24-4d4f-8d37-0a358f73ac23'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:46:50.819507 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-45ff1a74-6469-496f-8ce9-610b560b5b81 req-934e99a7-2997-430c-8ee2-137db185a49f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565994 May 26 14:46:50.822185 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-65c29472-652e-44c5-a6ed-73bc91c62c61 req-f997deba-63ae-48cb-bcdd-a6a2c1dcc1cf tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0736043 May 26 14:46:51.016824 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5baad4b8-8e0a-439d-accc-76497ecefabf req-3f5347db-7132-43d2-a617-4af5bc8f2817 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:51.018255 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5baad4b8-8e0a-439d-accc-76497ecefabf req-3f5347db-7132-43d2-a617-4af5bc8f2817 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0872269 May 26 14:46:51.054446 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 44056) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:51.068839 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5baad4b8-8e0a-439d-accc-76497ecefabf req-d6aedbfa-79b9-4c8e-a2dd-291ab73fcdb5 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0446801 May 26 14:46:51.175376 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.192278 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:51.196855 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Usage tracker for resource:security_group_rule and tenant:72d2ef7c817147fca0a008676dbece0f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:51.199960 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:51.206687 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:51.293871 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.299537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.306430 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a483d0f4-210a-4301-95db-24de32e9e104 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:51.353973 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa8cb156-f7c4-4c41-bc14-1f6947aaf030,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:51.358452 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=72d2ef7c817147fca0a008676dbece0f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3021312 May 26 14:46:51.359303 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:51.361170 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 44064) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:51.421070 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ad09c16c-f340-4fd0-89f1-c833acad3433 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.447575 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ad09c16c-f340-4fd0-89f1-c833acad3433 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.501958 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ad09c16c-f340-4fd0-89f1-c833acad3433 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.506993 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8305401a-7bcf-467b-bb47-8dddfdda8dd0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:51.521054 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad09c16c-f340-4fd0-89f1-c833acad3433 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa8cb156-f7c4-4c41-bc14-1f6947aaf030,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:51.524571 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ad09c16c-f340-4fd0-89f1-c833acad3433 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:51.532050 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ad09c16c-f340-4fd0-89f1-c833acad3433 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.533189 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-ad09c16c-f340-4fd0-89f1-c833acad3433 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/aa8cb156-f7c4-4c41-bc14-1f6947aaf030 HTTP/1.1" status: 204 len: 168 time: 0.1711226 May 26 14:46:51.627696 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-128f07db-2555-4622-8a97-12966076a041 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.845527 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 44074) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:51.865697 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.884567 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:51.888899 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Usage tracker for resource:security_group_rule and tenant:566d537138eb440e8ab609d8f8a17649 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:51.891754 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:51.897440 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:51.954687 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:46:51.993522 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:51.999006 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:52.048981 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:46:52.049322 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:52.110155 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-54db7bd6-a92b-4c3f-89c5-5bcd3827a748 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:52.119676 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381ff637-b122-42d7-acfb-65640c7d7c3e req-8981a7ec-bd23-480d-bfaa-b0d0d8e245d8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:52.121900 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-381ff637-b122-42d7-acfb-65640c7d7c3e req-8981a7ec-bd23-480d-bfaa-b0d0d8e245d8 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1771522 May 26 14:46:52.130968 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab1b9b91-c69f-4dd3-8be3-555590d43e1b req-e5c13b7d-53f7-4254-96c3-655807a8e9ec tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:52.138165 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ab1b9b91-c69f-4dd3-8be3-555590d43e1b req-e5c13b7d-53f7-4254-96c3-655807a8e9ec tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 945 time: 0.1608951 May 26 14:46:52.156287 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=566d537138eb440e8ab609d8f8a17649&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3072832 May 26 14:46:52.156287 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9fa1afa8-dc4d-435e-bc3c-ec193d19c677,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:52.158666 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6fda9daa-7a4a-471e-bfee-75b80c7f06f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:52.159208 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 44084) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:52.224840 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0858f990-c0f8-4854-9a1c-b476ac8db9af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:52.237022 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:52.239775 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ab1b9b91-c69f-4dd3-8be3-555590d43e1b req-c8cc9ed2-48aa-4be4-b0f8-1b406cf46aaa tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1003799 May 26 14:46:52.255950 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0858f990-c0f8-4854-9a1c-b476ac8db9af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:52.261024 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-381ff637-b122-42d7-acfb-65640c7d7c3e req-5d6f22d0-f0ba-497e-b6ff-56eb4e0b7188 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1197135 May 26 14:46:52.268865 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:46:52.291427 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:46:52.297863 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:52.305998 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:52.327872 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0858f990-c0f8-4854-9a1c-b476ac8db9af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:52.332176 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-25cd25d4-f21a-47b3-8f99-c55c7c6d43a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:52.344878 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0858f990-c0f8-4854-9a1c-b476ac8db9af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9fa1afa8-dc4d-435e-bc3c-ec193d19c677,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:52.345101 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'code': 200} May 26 14:46:52.348637 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0858f990-c0f8-4854-9a1c-b476ac8db9af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:52.364855 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0858f990-c0f8-4854-9a1c-b476ac8db9af admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:52.366140 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0858f990-c0f8-4854-9a1c-b476ac8db9af admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9fa1afa8-dc4d-435e-bc3c-ec193d19c677 HTTP/1.1" status: 204 len: 168 time: 0.2059660 May 26 14:46:52.413290 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=10']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:52.417233 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:52.496286 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee486b5-ab77-4e0e-be44-34726f2cf9b3 req-9c10e6a2-6df3-402f-bd50-df6d293f73e1 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:52.497731 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aee486b5-ab77-4e0e-be44-34726f2cf9b3 req-9c10e6a2-6df3-402f-bd50-df6d293f73e1 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.1041698 May 26 14:46:52.549549 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-aee486b5-ab77-4e0e-be44-34726f2cf9b3 req-ac00940e-8ab7-473c-b2cf-45a98ecfd6e5 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0461082 May 26 14:46:52.930505 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f578d7b-e49c-4cc9-973f-0e29ddf0d18f req-4a765bda-58d4-4745-8758-2ee824ace944 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:52.932029 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3f578d7b-e49c-4cc9-973f-0e29ddf0d18f req-4a765bda-58d4-4745-8758-2ee824ace944 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0930533 May 26 14:46:52.989838 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3f578d7b-e49c-4cc9-973f-0e29ddf0d18f req-47db2f4f-1f02-4e0a-8412-21342f0fb8b2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514946 May 26 14:46:53.156760 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de9b89ba-9ca1-4b88-a2b1-8247dfe544b8 req-0a338dc0-398b-46dd-b38d-4c362477301b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:53.158350 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-de9b89ba-9ca1-4b88-a2b1-8247dfe544b8 req-0a338dc0-398b-46dd-b38d-4c362477301b service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 1100 time: 0.0821607 May 26 14:46:53.207687 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-de9b89ba-9ca1-4b88-a2b1-8247dfe544b8 req-dd9bb461-7c59-4d92-8009-8de5f7ec9d2a service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0355041 May 26 14:46:53.262297 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-53d62916-e640-4748-bd3d-01f16fb670e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:53.527522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bf3d71-bfe5-4f1a-8b47-8d9da73eda5c req-c93f2a28-db97-43da-aa1c-c41dad192ab7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:53.529474 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-10bf3d71-bfe5-4f1a-8b47-8d9da73eda5c req-c93f2a28-db97-43da-aa1c-c41dad192ab7 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1520734 May 26 14:46:53.543816 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2542dbf-4809-4386-8cdf-d8eb1f939aa6 req-6adc557f-2eed-4be7-809f-deb8f7e42ee1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:53.545327 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2542dbf-4809-4386-8cdf-d8eb1f939aa6 req-6adc557f-2eed-4be7-809f-deb8f7e42ee1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 947 time: 0.1291215 May 26 14:46:53.617848 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-10bf3d71-bfe5-4f1a-8b47-8d9da73eda5c req-cd50c3ed-ee7c-4ff6-b290-2bce8dc441bb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713525 May 26 14:46:53.627785 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2542dbf-4809-4386-8cdf-d8eb1f939aa6 req-ce97be4e-3785-475f-9630-ce080c5d543a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0673549 May 26 14:46:53.848923 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:53.891733 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcca3d26-ac83-4ddc-8b81-8346ad35e0e8 req-283c8345-ec7e-4847-adb4-377ca7aad667 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:53.893274 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fcca3d26-ac83-4ddc-8b81-8346ad35e0e8 req-283c8345-ec7e-4847-adb4-377ca7aad667 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.1727788 May 26 14:46:53.940765 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fcca3d26-ac83-4ddc-8b81-8346ad35e0e8 req-feaa5b83-9f09-428b-89c1-50b61de20aa6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0415556 May 26 14:46:54.182651 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febb20e1-dcca-4bff-b882-02baf62e32a2 req-410f37b4-9890-42c6-9518-2a38e44859a9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:54.184403 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-febb20e1-dcca-4bff-b882-02baf62e32a2 req-410f37b4-9890-42c6-9518-2a38e44859a9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0850728 May 26 14:46:54.236855 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-febb20e1-dcca-4bff-b882-02baf62e32a2 req-b6f858b8-6279-4953-8bd4-0cc0b436930b tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397468 May 26 14:46:54.353884 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 44160) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:54.473226 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:54.490486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:54.494708 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Usage tracker for resource:security_group_rule and tenant:5fb60026c9f341b6a34e61212f5bed40 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:54.497693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:54.503901 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:54.560627 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:54.593184 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:54.598104 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:54.607117 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9380c174-45fa-49a6-8684-0a4aa62c55d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:54.656244 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44174) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:54.667152 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=5fb60026c9f341b6a34e61212f5bed40&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3119893 May 26 14:46:54.672078 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=074f2870-fbf5-499d-9afe-18ae1cddc85b,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:54.677429 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:54.745159 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-678e4598-1137-4e85-99ee-bd5e35b3a818 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:54.785903 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-678e4598-1137-4e85-99ee-bd5e35b3a818 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:54.971196 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-678e4598-1137-4e85-99ee-bd5e35b3a818 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:54.981755 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70782d34-bab9-40c1-b40d-db0a7440a3b2 req-142a1d86-48f9-470b-99b3-1425adf0a15b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:54.983247 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-70782d34-bab9-40c1-b40d-db0a7440a3b2 req-142a1d86-48f9-470b-99b3-1425adf0a15b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 947 time: 0.1820061 May 26 14:46:54.986471 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9b6b8cb0-4259-46e8-b0c9-c7880c37d0b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:55.005536 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cacf583-78fb-40d2-ab7e-86f6f7ddb126 req-d492b134-20e1-4c6c-8f45-ada09de67732 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:55.007385 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0cacf583-78fb-40d2-ab7e-86f6f7ddb126 req-d492b134-20e1-4c6c-8f45-ada09de67732 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.2049961 May 26 14:46:55.027133 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-678e4598-1137-4e85-99ee-bd5e35b3a818 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=074f2870-fbf5-499d-9afe-18ae1cddc85b,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:55.046931 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-678e4598-1137-4e85-99ee-bd5e35b3a818 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:55.064740 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-678e4598-1137-4e85-99ee-bd5e35b3a818 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:55.065785 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-678e4598-1137-4e85-99ee-bd5e35b3a818 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/074f2870-fbf5-499d-9afe-18ae1cddc85b HTTP/1.1" status: 204 len: 168 time: 0.4086761 May 26 14:46:55.091598 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-70782d34-bab9-40c1-b40d-db0a7440a3b2 req-0801c1fa-067b-4095-b3b1-60911b880308 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0985630 May 26 14:46:55.096159 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0cacf583-78fb-40d2-ab7e-86f6f7ddb126 req-d0ff4a67-49cb-4729-ae53-3a9d226e138a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703163 May 26 14:46:55.304221 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abbbd3c-5457-436c-b5e6-814c012f8642 req-00273561-1e75-4bea-9ea9-6e0a7c4bc479 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:55.311831 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0abbbd3c-5457-436c-b5e6-814c012f8642 req-00273561-1e75-4bea-9ea9-6e0a7c4bc479 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0974784 May 26 14:46:55.371529 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0abbbd3c-5457-436c-b5e6-814c012f8642 req-c1a639e2-a90f-4782-855b-8e431ddf2c43 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0579464 May 26 14:46:55.442343 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44218) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:55.469252 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:55.485322 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:55.490664 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Usage tracker for resource:security_group_rule and tenant:492abb6de68b419eb9579f9582b4bb0e is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:55.495484 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:55.502338 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:55.627073 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-a62651fc-3dcd-4c91-b3cd-a4abfe39112c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:55.629164 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-a62651fc-3dcd-4c91-b3cd-a4abfe39112c service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 1100 time: 0.0866611 May 26 14:46:55.679816 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1c43c3e-e7df-499f-86ff-283a7dd38e50 req-2ecd1b77-87d0-42c0-aec4-6e68f3ca5aca tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:55.681388 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c1c43c3e-e7df-499f-86ff-283a7dd38e50 req-2ecd1b77-87d0-42c0-aec4-6e68f3ca5aca tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1284349 May 26 14:46:55.686600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:55.712259 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:55.721738 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-97829840-be9c-44a7-86ef-e4ff01416a9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:55.775840 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=492abb6de68b419eb9579f9582b4bb0e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3323126 May 26 14:46:55.778666 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 44224) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:55.785882 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c1c43c3e-e7df-499f-86ff-283a7dd38e50 req-a5e236f3-5782-4835-b6e1-9b1765794493 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0978088 May 26 14:46:55.786723 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=152859a5-a19b-470b-bcc9-0a505a89d616,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:55.789703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:55.789837 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-2a2de1d3-5505-44ae-9680-af080f036935 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:55.791336 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-2a2de1d3-5505-44ae-9680-af080f036935 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1425810 May 26 14:46:55.888148 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:55.928830 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-2d6e3740-1ef0-4f41-8812-4aca3d3cfda4 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23 HTTP/1.1" status: 200 len: 1001 time: 0.1272595 May 26 14:46:55.983453 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5206d54e-4db2-4e18-a48f-b36d48aa8dcb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:56.022836 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5206d54e-4db2-4e18-a48f-b36d48aa8dcb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:56.034789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-69d351b3-e498-4d68-b66b-308809046aa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:56.036198 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-69d351b3-e498-4d68-b66b-308809046aa1 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0975406 May 26 14:46:56.135491 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-8073290d-b771-41d5-a601-db77b5566d37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:56.137200 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-8073290d-b771-41d5-a601-db77b5566d37 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0925250 May 26 14:46:56.138215 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5206d54e-4db2-4e18-a48f-b36d48aa8dcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:56.142855 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:56.182392 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5206d54e-4db2-4e18-a48f-b36d48aa8dcb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=152859a5-a19b-470b-bcc9-0a505a89d616,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:56.184879 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5206d54e-4db2-4e18-a48f-b36d48aa8dcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:56.249671 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5206d54e-4db2-4e18-a48f-b36d48aa8dcb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:56.250897 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5206d54e-4db2-4e18-a48f-b36d48aa8dcb admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/152859a5-a19b-470b-bcc9-0a505a89d616 HTTP/1.1" status: 204 len: 168 time: 0.4687526 May 26 14:46:56.296610 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-61df0e0c-6dbf-4916-923c-ed254eeafdcc service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1470995 May 26 14:46:56.386158 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51aa8813-890c-4400-abcd-4553bfd2e6d5 req-3509ac2c-9046-4445-953b-3dc18b5992cd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:56.387885 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-51aa8813-890c-4400-abcd-4553bfd2e6d5 req-3509ac2c-9046-4445-953b-3dc18b5992cd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 947 time: 0.1574094 May 26 14:46:56.402997 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5d2f50-95a9-41c0-b7ee-800fb517863e req-7996a0b1-882b-466f-a942-c33d0fe6e090 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:56.405449 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1f5d2f50-95a9-41c0-b7ee-800fb517863e req-7996a0b1-882b-466f-a942-c33d0fe6e090 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1291583 May 26 14:46:56.445088 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6d13f2aa-8b97-4f16-aa64-f280d470056f req-565d029d-ba09-4957-8cf0-2aa23240c8f2 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1381054 May 26 14:46:56.482471 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-51aa8813-890c-4400-abcd-4553bfd2e6d5 req-332c364d-ea64-4239-b7b5-984ff121cc46 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0758989 May 26 14:46:56.486999 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1f5d2f50-95a9-41c0-b7ee-800fb517863e req-d8ed3868-1b22-4415-8002-2733742c67bc tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655658 May 26 14:46:56.674676 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0860510-f7a9-4d55-a7a5-92ecf4f8ee44 req-7b7698f6-953c-4a34-ba04-2331fe615d5c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:56.676297 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c0860510-f7a9-4d55-a7a5-92ecf4f8ee44 req-7b7698f6-953c-4a34-ba04-2331fe615d5c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0867317 May 26 14:46:56.723988 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c0860510-f7a9-4d55-a7a5-92ecf4f8ee44 req-51f06bcb-4994-41f0-a20b-5b8f898968a0 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0414250 May 26 14:46:57.020016 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96fc10a9-4e48-425d-a847-4f781bcb59e8 req-95cca771-7bfe-483a-acf0-63e5ec136baa tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:57.021548 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-96fc10a9-4e48-425d-a847-4f781bcb59e8 req-95cca771-7bfe-483a-acf0-63e5ec136baa tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0833681 May 26 14:46:57.068640 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-96fc10a9-4e48-425d-a847-4f781bcb59e8 req-6a3e2793-a3e4-4490-a355-ddf06ad8c180 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406899 May 26 14:46:57.459607 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:57.700039 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85bb148-e753-4783-ba91-8492640af983 req-b3bb0fe9-ef54-471d-9084-bc62dabfa79e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:57.702756 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c85bb148-e753-4783-ba91-8492640af983 req-b3bb0fe9-ef54-471d-9084-bc62dabfa79e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0879016 May 26 14:46:57.751199 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c85bb148-e753-4783-ba91-8492640af983 req-6c8fb6c3-2405-4c9d-b8ea-fe47be5c217a tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433638 May 26 14:46:57.915311 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e36fdf-a021-4bac-93fe-3d735d1f40b1 req-58c00256-f688-44ad-8a65-f98aeab9caf9 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:57.917386 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1e36fdf-a021-4bac-93fe-3d735d1f40b1 req-58c00256-f688-44ad-8a65-f98aeab9caf9 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0820527 May 26 14:46:57.972974 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1e36fdf-a021-4bac-93fe-3d735d1f40b1 req-90faa27a-2195-4da0-ad95-677acc86d5d9 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0492089 May 26 14:46:58.259657 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cff5d60-f04f-4b3b-a19d-984c32a06b78 req-4177091a-4b88-45eb-a196-21599ecc8d3e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:58.261114 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8cff5d60-f04f-4b3b-a19d-984c32a06b78 req-4177091a-4b88-45eb-a196-21599ecc8d3e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0826857 May 26 14:46:58.318876 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8cff5d60-f04f-4b3b-a19d-984c32a06b78 req-448183b3-056c-4974-9a75-5cc8e010a365 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516865 May 26 14:46:58.442762 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44308) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:58.485684 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcda4745-d559-45b1-b395-75130afdafc0 req-d2fcd31d-700f-452f-82c1-6a6676bb9836 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:58.487220 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bcda4745-d559-45b1-b395-75130afdafc0 req-d2fcd31d-700f-452f-82c1-6a6676bb9836 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1098 time: 0.0750225 May 26 14:46:58.528536 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bcda4745-d559-45b1-b395-75130afdafc0 req-afe419b1-13d2-4f80-97a8-c956ec2e5984 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336928 May 26 14:46:58.564174 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:58.579164 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:58.583396 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Usage tracker for resource:security_group_rule and tenant:331838b2607a4c79b95cb27886cb3a35 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:58.586357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:58.592440 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:58.700088 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:58.705560 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:58.716357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:58.755373 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff577441-5d14-4f18-8a0a-a7937c94a971,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:58.759859 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=331838b2607a4c79b95cb27886cb3a35&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3160822 May 26 14:46:58.760711 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:58.762665 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44318) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:58.821368 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c11b83d4-c911-4482-9be0-7f0a5af29412 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:58.847586 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c11b83d4-c911-4482-9be0-7f0a5af29412 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.045713 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592ecda5-1bcf-4908-81fb-63413e3d27cb req-6f8b5ee7-17ca-4348-8fcc-adb1f0bb2e57 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:59.047281 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-592ecda5-1bcf-4908-81fb-63413e3d27cb req-6f8b5ee7-17ca-4348-8fcc-adb1f0bb2e57 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1907115 May 26 14:46:59.049420 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c11b83d4-c911-4482-9be0-7f0a5af29412 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.056029 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-8342fd48-926b-43da-a3d9-1b37eaa3a82f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:59.086853 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c11b83d4-c911-4482-9be0-7f0a5af29412 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff577441-5d14-4f18-8a0a-a7937c94a971,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:59.086853 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c11b83d4-c911-4482-9be0-7f0a5af29412 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:59.113528 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c11b83d4-c911-4482-9be0-7f0a5af29412 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.114612 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c11b83d4-c911-4482-9be0-7f0a5af29412 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/ff577441-5d14-4f18-8a0a-a7937c94a971 HTTP/1.1" status: 204 len: 168 time: 0.3510630 May 26 14:46:59.152111 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-592ecda5-1bcf-4908-81fb-63413e3d27cb req-d16aba29-79c8-4990-bf2e-54e710995fae tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971067 May 26 14:46:59.196285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f25bd24-452a-4eb5-a224-8b4be8e5261d req-fe217eb8-ee24-4fa9-8e20-86f315b48b3e tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:59.197718 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1f25bd24-452a-4eb5-a224-8b4be8e5261d req-fe217eb8-ee24-4fa9-8e20-86f315b48b3e tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0884590 May 26 14:46:59.249814 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1f25bd24-452a-4eb5-a224-8b4be8e5261d req-4af17ad1-3308-4384-b547-9150690ee8e0 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0459874 May 26 14:46:59.408034 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44342) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:59.425703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.480612 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:46:59.486681 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Usage tracker for resource:security_group_rule and tenant:f759cbdd5a0d44508b2e83902c0d082c is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:46:59.494090 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:46:59.502334 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:46:59.558135 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7232f4dc-24f6-407d-9ebd-efd921e20b97 req-d8905f2f-aa07-49db-80b7-11886ed1de3f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:46:59.559751 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7232f4dc-24f6-407d-9ebd-efd921e20b97 req-d8905f2f-aa07-49db-80b7-11886ed1de3f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1253226 May 26 14:46:59.633837 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7232f4dc-24f6-407d-9ebd-efd921e20b97 req-62004b76-47b2-47ce-af18-63259f0a94bc tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0675888 May 26 14:46:59.647390 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.653323 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.659928 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ede06602-4820-4ae6-8a7a-a49cbe8d5ec9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:59.699672 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82df7834-4dc1-4fd1-86bc-43ba9ec92a89,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:59.704351 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f759cbdd5a0d44508b2e83902c0d082c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2948871 May 26 14:46:59.705444 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:59.707460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 44346) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:46:59.766822 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-49538cbb-5384-404a-95c3-299528cbc758 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.791767 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-49538cbb-5384-404a-95c3-299528cbc758 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.846044 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-49538cbb-5384-404a-95c3-299528cbc758 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.851015 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0858f990-c0f8-4854-9a1c-b476ac8db9af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:46:59.867050 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49538cbb-5384-404a-95c3-299528cbc758 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82df7834-4dc1-4fd1-86bc-43ba9ec92a89,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:46:59.870021 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-49538cbb-5384-404a-95c3-299528cbc758 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:46:59.872394 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-49538cbb-5384-404a-95c3-299528cbc758 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:46:59.873186 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-49538cbb-5384-404a-95c3-299528cbc758 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/82df7834-4dc1-4fd1-86bc-43ba9ec92a89 HTTP/1.1" status: 204 len: 168 time: 0.1646330 May 26 14:47:00.374849 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae4e720-3cb4-48d3-b973-b16e79f963da req-44e49aee-d735-487d-9019-a0b240ff2590 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:00.377168 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dae4e720-3cb4-48d3-b973-b16e79f963da req-44e49aee-d735-487d-9019-a0b240ff2590 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1046965 May 26 14:47:00.472319 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dae4e720-3cb4-48d3-b973-b16e79f963da req-1c71227b-8e10-47f7-9a7c-65915cb0aae2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597575 May 26 14:47:00.503092 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45e055b9-89d2-42e2-81ce-d61258d45e23 req-4a187ca3-65ed-4040-9e9f-3e3b7ba8373c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:00.504799 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-45e055b9-89d2-42e2-81ce-d61258d45e23 req-4a187ca3-65ed-4040-9e9f-3e3b7ba8373c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.1383786 May 26 14:47:00.567367 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-45e055b9-89d2-42e2-81ce-d61258d45e23 req-094d8a13-8bf9-4047-bce1-65186d2b5eb3 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0560794 May 26 14:47:00.835222 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5e133c-182f-4df9-8b50-47e08f4f5572 req-d30ded55-58d3-4bf0-a566-a6864ab1a10b tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:00.836771 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2e5e133c-182f-4df9-8b50-47e08f4f5572 req-d30ded55-58d3-4bf0-a566-a6864ab1a10b tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0873103 May 26 14:47:00.889130 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2e5e133c-182f-4df9-8b50-47e08f4f5572 req-65d30ae8-ab5b-45f3-a962-d3e6f625a234 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416009 May 26 14:47:00.986490 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-9b691cbf-2ecb-4e60-a8a7-af6336274c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:00.989004 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-9b691cbf-2ecb-4e60-a8a7-af6336274c90 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 1098 time: 0.0767858 May 26 14:47:01.015578 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f35875-fafe-4068-8df6-54da58e9e7b6 req-7425d1e5-79a9-44d7-86ea-da7c61d49b2b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:01.017413 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c5f35875-fafe-4068-8df6-54da58e9e7b6 req-7425d1e5-79a9-44d7-86ea-da7c61d49b2b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0903406 May 26 14:47:01.070895 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c5f35875-fafe-4068-8df6-54da58e9e7b6 req-f5479eb4-c1fe-4cdd-982b-af50a174c91f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469658 May 26 14:47:01.133030 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-42ccb8f6-1e87-4a34-bee9-dda68b31baf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:01.134597 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-42ccb8f6-1e87-4a34-bee9-dda68b31baf2 service neutron] 10.222.0.79 "GET /v2.0/networks?id=d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 200 len: 919 time: 0.1373065 May 26 14:47:01.290736 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-8626d99f-baac-4940-80a4-613d1bc3cf3d service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 200 len: 217 time: 0.1409400 May 26 14:47:01.369484 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-e2289c70-715c-41d7-9d0e-82f7a346d3bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:01.370974 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-e2289c70-715c-41d7-9d0e-82f7a346d3bf service neutron] 10.222.0.79 "GET /v2.0/subnets?id=f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 200 len: 857 time: 0.0638871 May 26 14:47:01.426871 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-ebfec35c-9e25-48c4-acb2-02bda5d00770 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=d130e7f3-8552-49d7-bcfd-3db8c3289227&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0409663 May 26 14:47:01.572686 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-0f96ec14-e4cb-4a9d-be08-21326bec82ed service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1360655 May 26 14:47:01.728373 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6c3d8819-71c4-4151-8185-e52bd456c3f2 req-80deb8a7-75f2-476c-9dc8-248019e7ac09 service neutron] 10.222.0.79 "GET /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310220 May 26 14:47:01.760332 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fcf6898-b9cd-4f2b-9f9d-b6deed02ec1f req-b5ae83d8-c700-4454-82df-690778c565f7 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:01.761829 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9fcf6898-b9cd-4f2b-9f9d-b6deed02ec1f req-b5ae83d8-c700-4454-82df-690778c565f7 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0861545 May 26 14:47:01.809623 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9fcf6898-b9cd-4f2b-9f9d-b6deed02ec1f req-a0b43d24-079c-4710-af8d-dd75f1deb8b4 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0416281 May 26 14:47:02.106493 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cace3ac8-4c53-428a-9e1f-56eaaf9dc891 req-8e907a3e-9db4-4ee9-971e-74189e816597 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:02.113690 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cace3ac8-4c53-428a-9e1f-56eaaf9dc891 req-8e907a3e-9db4-4ee9-971e-74189e816597 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1029861 May 26 14:47:02.156759 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cace3ac8-4c53-428a-9e1f-56eaaf9dc891 req-3819e095-24e8-40b0-9075-58b2ebaf9191 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422072 May 26 14:47:02.260025 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0701cc0-e56b-4ec8-a422-acd6987ebee4 req-9ac21d83-0491-445a-a148-a317eb1ccddd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:02.261461 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c0701cc0-e56b-4ec8-a422-acd6987ebee4 req-9ac21d83-0491-445a-a148-a317eb1ccddd tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0825455 May 26 14:47:02.308097 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c0701cc0-e56b-4ec8-a422-acd6987ebee4 req-a58a3325-8048-4667-b3b5-43c5107fed38 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405586 May 26 14:47:03.009518 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b6ee8f-f04b-46a6-924d-24c00c09d214 req-9ba9651a-6904-4fcf-9a72-a118d15db0c5 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:03.011403 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e1b6ee8f-f04b-46a6-924d-24c00c09d214 req-9ba9651a-6904-4fcf-9a72-a118d15db0c5 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0890331 May 26 14:47:03.061138 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e1b6ee8f-f04b-46a6-924d-24c00c09d214 req-91068852-2b6b-4e4f-9bc9-e033bdb94f82 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0436404 May 26 14:47:03.571264 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-949878b0-3f58-410a-9f82-5cbfab16d70a req-fb13e517-458d-459b-a3ae-125a2b009490 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:03.572621 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-949878b0-3f58-410a-9f82-5cbfab16d70a req-fb13e517-458d-459b-a3ae-125a2b009490 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1474473 May 26 14:47:03.583603 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14623d1-c5db-4652-9794-f28bde08d40e req-ee51bf49-c481-48ba-bd42-265a67417b25 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:03.585004 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c14623d1-c5db-4652-9794-f28bde08d40e req-ee51bf49-c481-48ba-bd42-265a67417b25 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1228316 May 26 14:47:03.652122 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-949878b0-3f58-410a-9f82-5cbfab16d70a req-12810bea-e2ca-4cc0-8658-6a0cf98af881 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0661983 May 26 14:47:03.656631 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c14623d1-c5db-4652-9794-f28bde08d40e req-d9481347-182e-4f63-830d-56d86b3cb078 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576382 May 26 14:47:04.015424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c20f661-cc24-4f21-b5dc-428a75be7ae9 req-4f3c4d2a-0520-4b07-8967-6c9a714dcfa2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:04.018811 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5c20f661-cc24-4f21-b5dc-428a75be7ae9 req-4f3c4d2a-0520-4b07-8967-6c9a714dcfa2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0882473 May 26 14:47:04.063288 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5c20f661-cc24-4f21-b5dc-428a75be7ae9 req-acb4c970-251a-431c-b8b5-ccb35e4d5770 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402973 May 26 14:47:04.107673 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-34f233da-253c-4fbe-944c-11f80c9f83b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:04.109227 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-34f233da-253c-4fbe-944c-11f80c9f83b2 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 1098 time: 0.0819743 May 26 14:47:04.261134 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-ef0525d2-92f2-4c8f-8442-8f64de6e6b97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:04.262294 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752caee0-1e80-4224-93ed-371da9d55811 req-46aad42c-a1d4-4ca5-a5d2-cccfce4ec3fb tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:04.262700 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-ef0525d2-92f2-4c8f-8442-8f64de6e6b97 service neutron] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 913 time: 0.1388276 May 26 14:47:04.263899 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-752caee0-1e80-4224-93ed-371da9d55811 req-46aad42c-a1d4-4ca5-a5d2-cccfce4ec3fb tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0842538 May 26 14:47:04.326282 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-752caee0-1e80-4224-93ed-371da9d55811 req-24ca62f1-7b4b-45a7-9e1a-122c9e6502c3 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0561213 May 26 14:47:04.372672 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-d17ba48d-3a6b-4798-bc8e-9d137b503fbd service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0 HTTP/1.1" status: 200 len: 1001 time: 0.0994346 May 26 14:47:04.441859 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-962927d5-f8af-462f-818e-735d9bfc7d02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:04.443358 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-962927d5-f8af-462f-818e-735d9bfc7d02 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.0641518 May 26 14:47:04.522707 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-c75061ca-de9a-4842-a67b-91f1d72ee82b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:04.524204 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-c75061ca-de9a-4842-a67b-91f1d72ee82b service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0732987 May 26 14:47:04.664693 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-f3cd0a51-7fa1-419d-ac58-fc40c7d4e739 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1306460 May 26 14:47:04.817942 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44462) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:04.827828 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-75abcce0-c14b-41eb-bad7-1172812f2d33 req-957eced3-ada8-4ba8-a16c-842965ec3ce4 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1474814 May 26 14:47:04.868715 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5afadb-a1c3-4e72-9829-3dbe18b0e1fe req-46d311a3-9855-4605-bb37-f2125372e14b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:04.870238 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0b5afadb-a1c3-4e72-9829-3dbe18b0e1fe req-46d311a3-9855-4605-bb37-f2125372e14b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0918856 May 26 14:47:04.924281 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0b5afadb-a1c3-4e72-9829-3dbe18b0e1fe req-76c267a1-f0c6-485c-a59c-c2e709969fa3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448189 May 26 14:47:04.949227 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:04.964741 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:04.968580 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Usage tracker for resource:security_group_rule and tenant:d8fcc99159f04ed095f43053ad7e4460 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:04.971413 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:04.977018 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:05.062126 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:05.070799 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:05.079270 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-350f92e9-e839-4fad-ac3b-764c3161fcc8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:05.123802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c5b87df-d700-425f-9fda-75901a164a46,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:05.128616 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d8fcc99159f04ed095f43053ad7e4460&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3097034 May 26 14:47:05.129789 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:05.131412 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 44478) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:05.217738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:05.246928 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:05.310331 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:05.319385 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9424d442-bd07-41a5-9d98-ee5c9025c5e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:05.349718 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c5b87df-d700-425f-9fda-75901a164a46,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:05.354562 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:05.355986 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/2c5b87df-d700-425f-9fda-75901a164a46 HTTP/1.1" status: 204 len: 168 time: 0.2236063 May 26 14:47:05.362986 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.363664 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.364173 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.364688 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.365390 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.365902 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.366434 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.366947 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.367488 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.367984 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.368488 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.368977 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:05.375233 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b4a77781-0e68-4cdb-be56-2edbdc35f178 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:05.498968 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33089201-48fa-4768-b3ec-53eba6fb561f req-99951e1e-e249-43bf-baf0-3b1ae491040d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:05.512111 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-33089201-48fa-4768-b3ec-53eba6fb561f req-99951e1e-e249-43bf-baf0-3b1ae491040d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.2285426 May 26 14:47:05.614228 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-33089201-48fa-4768-b3ec-53eba6fb561f req-41f5c823-3a49-4246-81df-69d2297e2b4c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0939875 May 26 14:47:05.765548 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30cf5509-7eed-4cb5-81e7-cb2901624e5e req-0f65f250-063c-4f49-827b-1b56739fde56 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:05.767034 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30cf5509-7eed-4cb5-81e7-cb2901624e5e req-0f65f250-063c-4f49-827b-1b56739fde56 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.1045141 May 26 14:47:05.814451 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30cf5509-7eed-4cb5-81e7-cb2901624e5e req-7551e4fb-a045-4187-aaf6-f0949725ffba tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0415063 May 26 14:47:06.830531 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4154b907-afb3-47ac-a763-2b89e37a5985 req-3aa95db1-cfc3-4eed-86b2-6daefe59920f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:06.831965 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4154b907-afb3-47ac-a763-2b89e37a5985 req-3aa95db1-cfc3-4eed-86b2-6daefe59920f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.0822046 May 26 14:47:06.877912 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4154b907-afb3-47ac-a763-2b89e37a5985 req-a7fbd062-3ece-499c-80b2-047f17006196 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385461 May 26 14:47:07.006075 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec9c64d-be9b-4144-b484-f1749d23c9dc req-e28bcbd5-6021-4a9d-a5a5-81e9260862b8 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:07.007565 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-eec9c64d-be9b-4144-b484-f1749d23c9dc req-e28bcbd5-6021-4a9d-a5a5-81e9260862b8 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0851502 May 26 14:47:07.056287 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-eec9c64d-be9b-4144-b484-f1749d23c9dc req-280fb354-3fc6-45d3-9a35-6ee7bb93df44 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0399778 May 26 14:47:08.245792 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4637c1-33b8-4d7b-ab02-4df58704239c req-591c9c30-6a73-4f0c-b13d-7762792eac89 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:08.247307 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c4637c1-33b8-4d7b-ab02-4df58704239c req-591c9c30-6a73-4f0c-b13d-7762792eac89 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.0826759 May 26 14:47:08.293531 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c4637c1-33b8-4d7b-ab02-4df58704239c req-2c9d31bf-dc29-49ec-84b8-7b555e3a20a2 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9&id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0403564 May 26 14:47:18.217282 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:47:21.631831 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ef738938-99e4-4838-a93e-c68e0ab0c94f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:22.857112 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f67339-44af-401f-bc78-e8bf19f79d8d req-e9c0f246-34a6-4eac-9ac7-fe481b652206 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:22.858522 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f2f67339-44af-401f-bc78-e8bf19f79d8d req-e9c0f246-34a6-4eac-9ac7-fe481b652206 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0922964 May 26 14:47:22.904404 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f2f67339-44af-401f-bc78-e8bf19f79d8d req-55978869-c098-4d72-bdd9-37f068def5c0 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397475 May 26 14:47:23.279646 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-2f706d6b-a4a7-48a0-b7c0-7bc584a95504 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:23.862166 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:24.110802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc69e0e3-043a-418b-80d2-8c954684f58b req-7f4f4fce-b070-4d4f-949f-06b477f4e44b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:24.112395 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dc69e0e3-043a-418b-80d2-8c954684f58b req-7f4f4fce-b070-4d4f-949f-06b477f4e44b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0838871 May 26 14:47:24.160995 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dc69e0e3-043a-418b-80d2-8c954684f58b req-cf919bc8-d2ce-4555-8be0-ee5d1e29a7e3 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428047 May 26 14:47:24.578814 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:25.360102 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f028998e-6c84-4558-95fa-f9941c85a001 req-aa8339a4-9b43-4c40-8520-05f0c8b05427 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:25.361585 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f028998e-6c84-4558-95fa-f9941c85a001 req-aa8339a4-9b43-4c40-8520-05f0c8b05427 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0826936 May 26 14:47:25.410478 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f028998e-6c84-4558-95fa-f9941c85a001 req-cfdb9cab-7b46-4aea-a636-79e1cc30b15b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429919 May 26 14:47:25.897630 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:26.614477 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e3868b6-4e49-4b9b-b455-a0e06dfea3d7 req-434bbb7e-40d1-44ec-893a-e19df4aae5c4 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:26.615924 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4e3868b6-4e49-4b9b-b455-a0e06dfea3d7 req-434bbb7e-40d1-44ec-893a-e19df4aae5c4 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0898361 May 26 14:47:26.663812 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4e3868b6-4e49-4b9b-b455-a0e06dfea3d7 req-a15a280a-9cf1-4707-9b2c-258e911fbafb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418165 May 26 14:47:27.469703 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:27.850623 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e238cb-e3c2-40ca-884f-38759e4531cc req-f3d68d4d-714e-4efb-9dec-bb4de95bf0e9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:27.852050 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-15e238cb-e3c2-40ca-884f-38759e4531cc req-f3d68d4d-714e-4efb-9dec-bb4de95bf0e9 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0799060 May 26 14:47:27.897654 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-15e238cb-e3c2-40ca-884f-38759e4531cc req-02e3aa27-fdf8-4798-af9d-c4020e49fad2 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397141 May 26 14:47:28.906786 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1957968-7a76-4311-828d-f076648f3081 req-58e7e6ac-7bcc-4008-b970-bb72d85146cb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:28.907453 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-a1957968-7a76-4311-828d-f076648f3081 req-58e7e6ac-7bcc-4008-b970-bb72d85146cb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Synchronizing usage tracker for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:47:28.924828 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-a1957968-7a76-4311-828d-f076648f3081 req-58e7e6ac-7bcc-4008-b970-bb72d85146cb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Unset dirty status for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:47:28.926228 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a1957968-7a76-4311-828d-f076648f3081 req-58e7e6ac-7bcc-4008-b970-bb72d85146cb tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.79 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0990193 May 26 14:47:29.087975 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Deleting port d08c2c2c-cb18-446f-bc59-613497b03a6c {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:47:29.088206 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:29.099996 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90195b11-6e58-46b7-bc94-43d922294e24 req-ed62e3e9-eacc-482b-8780-e28600adcc49 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:29.101471 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-90195b11-6e58-46b7-bc94-43d922294e24 req-ed62e3e9-eacc-482b-8780-e28600adcc49 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 946 time: 0.0892851 May 26 14:47:29.146913 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-90195b11-6e58-46b7-bc94-43d922294e24 req-d4826cc8-0836-40da-9ca7-8455ebad5866 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395856 May 26 14:47:29.221410 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] For port d08c2c2c-cb18-446f-bc59-613497b03a6c, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=d08c2c2c-cb18-446f-bc59-613497b03a6c,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:29.221787 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:29.429534 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Calling delete_port for d08c2c2c-cb18-446f-bc59-613497b03a6c owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:47:29.546197 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:29.551986 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:29.596000 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['020637e8-4ec8-4ab3-a8b0-c6891c725214', 'd08c2c2c-cb18-446f-bc59-613497b03a6c'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:47:29.599786 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Pushing event deleted for resources: {'Port': ['ID=d08c2c2c-cb18-446f-bc59-613497b03a6c,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:29.602993 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:29.673500 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] No DVR routers for this DVR port d08c2c2c-cb18-446f-bc59-613497b03a6c on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:47:29.676194 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:29.678908 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c', 'name': 'network-vif-deleted', 'tag': 'd08c2c2c-cb18-446f-bc59-613497b03a6c'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:47:29.697759 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-a1957968-7a76-4311-828d-f076648f3081 req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.79 "DELETE /v2.0/ports/d08c2c2c-cb18-446f-bc59-613497b03a6c HTTP/1.1" status: 204 len: 173 time: 0.7603104 May 26 14:47:29.728306 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c', 'name': 'network-vif-deleted', 'tag': 'd08c2c2c-cb18-446f-bc59-613497b03a6c', 'status': 'completed', 'code': 200} May 26 14:47:30.310716 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3d71efd0-544a-42ca-a7b8-ef2be9e3eb2c req-2bd10ed4-2ba0-440d-9592-cf9adbeb4b37 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=5acdda0a-7e7d-4d7b-b5e4-16c742cdea5c HTTP/1.1" status: 200 len: 210 time: 0.0433862 May 26 14:47:31.806558 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f8ba29-ae1c-4f5e-9929-2e46506796ff req-9a602a9a-a685-4375-91e2-2d56ea5de509 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:31.807989 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-69f8ba29-ae1c-4f5e-9929-2e46506796ff req-9a602a9a-a685-4375-91e2-2d56ea5de509 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0897961 May 26 14:47:31.852653 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-69f8ba29-ae1c-4f5e-9929-2e46506796ff req-7e92035c-4973-45ab-b1d2-88928f69e294 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387249 May 26 14:47:31.932348 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7826df89-1296-43cd-98cf-3c0d53f4ff99 req-95c2acf5-765b-4013-9408-db23f30fccaf tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:31.933782 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7826df89-1296-43cd-98cf-3c0d53f4ff99 req-95c2acf5-765b-4013-9408-db23f30fccaf tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0785732 May 26 14:47:31.980138 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7826df89-1296-43cd-98cf-3c0d53f4ff99 req-47cbf8c5-b60c-4a98-bdf6-d8ee4d00eb4d tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380461 May 26 14:47:32.256321 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device d08c2c2c-cb18-446f-bc59-613497b03a6c no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:47:32.298917 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: d08c2c2c-cb18-446f-bc59-613497b03a6c {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:47:32.299255 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device d08c2c2c-cb18-446f-bc59-613497b03a6c not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:47:33.045346 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338be11e-e995-4af5-ad0f-b1b507303553 req-9f7f3344-b9b6-46ca-bb9e-af0113e3ea8e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:33.046994 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-338be11e-e995-4af5-ad0f-b1b507303553 req-9f7f3344-b9b6-46ca-bb9e-af0113e3ea8e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0853367 May 26 14:47:33.125075 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-338be11e-e995-4af5-ad0f-b1b507303553 req-4f61e332-3421-4282-9779-0d6ccb0cab9f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718293 May 26 14:47:33.172652 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c504c713-1af8-4bde-b702-44682ba7a2aa req-1a8b8fd6-4b67-4fbd-a2e2-17e4b61ab5a5 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:33.174180 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c504c713-1af8-4bde-b702-44682ba7a2aa req-1a8b8fd6-4b67-4fbd-a2e2-17e4b61ab5a5 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.0857489 May 26 14:47:33.223167 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c504c713-1af8-4bde-b702-44682ba7a2aa req-a06785c5-f2b7-403c-9f1c-f26a961af829 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432928 May 26 14:47:34.125419 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-db7034d2-68c1-4b3e-a018-a3cfd7d56349 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:34.126098 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-db7034d2-68c1-4b3e-a018-a3cfd7d56349 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Synchronizing usage tracker for tenant:d1a7192ff14647f894360c51e8ceac5b on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:47:34.145769 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-db7034d2-68c1-4b3e-a018-a3cfd7d56349 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Unset dirty status for tenant:d1a7192ff14647f894360c51e8ceac5b on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:47:34.147065 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-db7034d2-68c1-4b3e-a018-a3cfd7d56349 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.79 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.1200981 May 26 14:47:34.294334 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Deleting port 5134882e-952e-454a-8d3a-826458d3d6bb {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:47:34.294699 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:34.334588 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01968bdf-1fdd-4406-9bf3-eb242a626741 req-1cf12220-122a-4857-94b2-3649208a0c22 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:34.336084 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-01968bdf-1fdd-4406-9bf3-eb242a626741 req-1cf12220-122a-4857-94b2-3649208a0c22 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1016486 May 26 14:47:34.430830 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] For port 5134882e-952e-454a-8d3a-826458d3d6bb, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=5134882e-952e-454a-8d3a-826458d3d6bb,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:34.431117 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-01968bdf-1fdd-4406-9bf3-eb242a626741 req-9a64aa75-ce17-4ba8-bd96-43613f5cc078 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879507 May 26 14:47:34.431393 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:34.458466 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4cc80f-11c5-4848-a1f1-2551afde69f3 req-7ce432c5-572f-4d72-a28a-7aa41f0e8938 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:34.459976 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f4cc80f-11c5-4848-a1f1-2551afde69f3 req-7ce432c5-572f-4d72-a28a-7aa41f0e8938 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 946 time: 0.1180587 May 26 14:47:34.505275 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f4cc80f-11c5-4848-a1f1-2551afde69f3 req-b3c8669f-5bd1-4f65-bf78-63a303ab5795 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395334 May 26 14:47:34.560948 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Calling delete_port for 5134882e-952e-454a-8d3a-826458d3d6bb owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:47:34.673939 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:34.680267 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:34.717935 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['5134882e-952e-454a-8d3a-826458d3d6bb'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:47:34.730054 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Pushing event deleted for resources: {'Port': ['ID=5134882e-952e-454a-8d3a-826458d3d6bb,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:34.732576 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:34.809375 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] No DVR routers for this DVR port 5134882e-952e-454a-8d3a-826458d3d6bb on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:47:34.812080 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:34.814614 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1aa656c9-a4aa-48ee-94a5-04c967e50d67', 'name': 'network-vif-deleted', 'tag': '5134882e-952e-454a-8d3a-826458d3d6bb'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:47:34.831927 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c5e328f6-b7d0-49f4-b58e-e7b86fed7227 req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.79 "DELETE /v2.0/ports/5134882e-952e-454a-8d3a-826458d3d6bb HTTP/1.1" status: 204 len: 173 time: 0.6713650 May 26 14:47:34.862904 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1aa656c9-a4aa-48ee-94a5-04c967e50d67', 'name': 'network-vif-deleted', 'tag': '5134882e-952e-454a-8d3a-826458d3d6bb', 'status': 'completed', 'code': 200} May 26 14:47:35.627212 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e58d8d9-721a-484e-a65f-df6426b6d4eb req-d906440d-4b87-4697-bdd3-3234970e6043 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:35.628883 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6e58d8d9-721a-484e-a65f-df6426b6d4eb req-d906440d-4b87-4697-bdd3-3234970e6043 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0844696 May 26 14:47:35.774206 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-471770bd-a03b-4d42-9faa-71dff89f02c2 req-967a3bd0-94d6-4abc-9974-d9f41c1186e0 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=1aa656c9-a4aa-48ee-94a5-04c967e50d67 HTTP/1.1" status: 200 len: 210 time: 0.1355340 May 26 14:47:35.794410 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6e58d8d9-721a-484e-a65f-df6426b6d4eb req-1215172d-36ad-4035-b145-20c52120f15b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1569872 May 26 14:47:36.976873 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5d9114-1b59-4282-a3a7-998e48c1ae3b req-68fb7329-04ac-4328-8fb3-e961d222755d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:36.978468 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4e5d9114-1b59-4282-a3a7-998e48c1ae3b req-68fb7329-04ac-4328-8fb3-e961d222755d tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0803878 May 26 14:47:37.028458 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4e5d9114-1b59-4282-a3a7-998e48c1ae3b req-dacd82eb-9f53-4627-87b1-59debccc5f4e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440242 May 26 14:47:38.224679 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23096689-4330-46a9-b2c6-7099ed0949b5 req-3dd15389-ce1a-471e-ba6f-e5c99d46ad9e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:38.226116 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-23096689-4330-46a9-b2c6-7099ed0949b5 req-3dd15389-ce1a-471e-ba6f-e5c99d46ad9e tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0835238 May 26 14:47:38.274219 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-23096689-4330-46a9-b2c6-7099ed0949b5 req-7c7df9b8-fbc3-44e7-b0c4-bed91ce35740 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394487 May 26 14:47:39.180446 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 5134882e-952e-454a-8d3a-826458d3d6bb no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:47:39.215570 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 5134882e-952e-454a-8d3a-826458d3d6bb {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:47:39.215918 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 5134882e-952e-454a-8d3a-826458d3d6bb not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:47:39.480328 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7baf71-1f15-4ba6-b1e3-2bb66f1e4ce1 req-511b0b43-53a1-4809-8476-4ab1a78ed6ee tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:39.481821 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cc7baf71-1f15-4ba6-b1e3-2bb66f1e4ce1 req-511b0b43-53a1-4809-8476-4ab1a78ed6ee tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0865028 May 26 14:47:39.527468 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cc7baf71-1f15-4ba6-b1e3-2bb66f1e4ce1 req-02a2a343-5e21-4af7-a916-0ff32c2ae098 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394802 May 26 14:47:40.729993 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c03b5cc7-630e-432c-a110-85d9c1714ced req-93452150-1431-46f2-952a-f1a3b164ff74 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:40.731471 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c03b5cc7-630e-432c-a110-85d9c1714ced req-93452150-1431-46f2-952a-f1a3b164ff74 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.0876155 May 26 14:47:40.776549 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c03b5cc7-630e-432c-a110-85d9c1714ced req-d95b9610-0df3-4696-85ad-94fa1b2c8926 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/security-groups?id=549dea61-4498-4c30-b369-c50278775a2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393274 May 26 14:47:40.852540 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-928d4713-b20e-4fb7-a756-7d3d683f4e8f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:40.853158 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-928d4713-b20e-4fb7-a756-7d3d683f4e8f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Synchronizing usage tracker for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:47:40.872778 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-928d4713-b20e-4fb7-a756-7d3d683f4e8f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Unset dirty status for tenant:ff8cee98b9cc47dd9a86993218bdede9 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:47:40.873928 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-928d4713-b20e-4fb7-a756-7d3d683f4e8f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.79 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 945 time: 0.1071560 May 26 14:47:41.028831 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Deleting port 020637e8-4ec8-4ab3-a8b0-c6891c725214 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:47:41.029115 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:41.187908 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] For port 020637e8-4ec8-4ab3-a8b0-c6891c725214, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=020637e8-4ec8-4ab3-a8b0-c6891c725214,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:41.188258 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:41.389716 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Calling delete_port for 020637e8-4ec8-4ab3-a8b0-c6891c725214 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:47:41.510115 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:41.515752 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:41.556830 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['020637e8-4ec8-4ab3-a8b0-c6891c725214'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:47:41.562964 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Pushing event deleted for resources: {'Port': ['ID=020637e8-4ec8-4ab3-a8b0-c6891c725214,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:41.566097 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:41.638292 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] No DVR routers for this DVR port 020637e8-4ec8-4ab3-a8b0-c6891c725214 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:47:41.640952 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:41.643487 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8233d5a-1404-4f72-b83a-4725d0a72066', 'name': 'network-vif-deleted', 'tag': '020637e8-4ec8-4ab3-a8b0-c6891c725214'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:47:41.660280 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-90fbd7d4-0e61-4e2a-a762-c0c8da7528ac req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.79 "DELETE /v2.0/ports/020637e8-4ec8-4ab3-a8b0-c6891c725214 HTTP/1.1" status: 204 len: 173 time: 0.7785084 May 26 14:47:41.689117 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8233d5a-1404-4f72-b83a-4725d0a72066', 'name': 'network-vif-deleted', 'tag': '020637e8-4ec8-4ab3-a8b0-c6891c725214', 'status': 'completed', 'code': 200} May 26 14:47:41.955485 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-24038805-cb55-4b97-96e9-97327031f8f2 req-2db4a1d7-cd8b-4203-95e8-c81fc2fdbf0f tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] 10.222.0.72 "GET /v2.0/ports?device_id=a8233d5a-1404-4f72-b83a-4725d0a72066 HTTP/1.1" status: 200 len: 210 time: 0.0468233 May 26 14:47:43.061473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44722) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:43.790244 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:44.200060 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Deleting port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:47:44.200704 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:44.423474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] For port 0b26b296-28ad-492a-9268-6d6f5e3fb2f1, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,segment=NetworkSegment(31f0bd82-c79b-40bf-8404-580a8d30b406),segment_id=31f0bd82-c79b-40bf-8404-580a8d30b406)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:44.423743 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:44.545883 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Calling delete_port for 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 owned by network:router_interface {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:47:44.841641 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:44.847145 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:44.891942 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Pushing event deleted for resources: {'Port': ['ID=0b26b296-28ad-492a-9268-6d6f5e3fb2f1,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:44.895127 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:45.159565 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:45.526202 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Router 4b252345-f758-472e-99df-5f8be3fcb13a has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:47:45.792942 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:47:45.802029 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] Sync routers for ids ['4b252345-f758-472e-99df-5f8be3fcb13a'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:47:45.812285 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] Routers {'4b252345-f758-472e-99df-5f8be3fcb13a'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:47:45.812901 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:47:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4b252345-f758-472e-99df-5f8be3fcb13a'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:45.816689 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] 10.222.0.72 "PUT /v2.0/routers/4b252345-f758-472e-99df-5f8be3fcb13a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7537835 May 26 14:47:45.819268 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44736) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:45.881228 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 020637e8-4ec8-4ab3-a8b0-c6891c725214 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:47:45.917190 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 020637e8-4ec8-4ab3-a8b0-c6891c725214 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:47:45.917536 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 020637e8-4ec8-4ab3-a8b0-c6891c725214 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:47:45.993499 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] Set router 4b252345-f758-472e-99df-5f8be3fcb13a gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:47:45.993912 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks [] for router, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:46.175919 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:46.255340 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Deleting port d716edee-1b42-40f1-9df5-42382e808d45 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:47:46.255683 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:46.308967 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211'}], 'enable_snat': True}, 'gw_port_id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:47:44Z', 'revision_number': 5, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port': {'id': 'd716edee-1b42-40f1-9df5-42382e808d45', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:21:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:46Z', 'updated_at': '2021-05-26T14:43:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:46.312868 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] Checking router: 4b252345-f758-472e-99df-5f8be3fcb13a for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:47:46.322388 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] Routers {'4b252345-f758-472e-99df-5f8be3fcb13a'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:47:46.323017 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:47:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4b252345-f758-472e-99df-5f8be3fcb13a'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:46.376149 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] For port d716edee-1b42-40f1-9df5-42382e808d45, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d716edee-1b42-40f1-9df5-42382e808d45,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:46.376533 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:46.473864 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] Set router 4b252345-f758-472e-99df-5f8be3fcb13a gateway port host: None {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:47:46.496947 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Calling delete_port for d716edee-1b42-40f1-9df5-42382e808d45 owned by network:router_gateway {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:47:46.577943 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:47:46Z', 'revision_number': 6, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:46.582260 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e8c2678-01da-49ed-84c2-82ff455093fa None None] The sync data for ids ['4b252345-f758-472e-99df-5f8be3fcb13a'] in dv-cinder-774594-6-iscsi is: [{'id': '4b252345-f758-472e-99df-5f8be3fcb13a', 'name': 'tempest-ServerRescueNegativeTestJSON-45717524-router', 'tenant_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:47:46Z', 'revision_number': 6, 'project_id': 'ff8cee98b9cc47dd9a86993218bdede9', 'gw_port_host': None}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:47:46.649672 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:46.653865 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b92e4e63-1b17-4c1f-98c9-27186b88efdc tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:46.698083 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Pushing event deleted for resources: {'Port': ['ID=d716edee-1b42-40f1-9df5-42382e808d45,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:46.701158 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:46.795647 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:46.970000 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:46.973208 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:47.063763 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:47.064415 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4b252345-f758-472e-99df-5f8be3fcb13a {{(pid=98445) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:47:47.087600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:47.089425 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] 10.222.0.72 "DELETE /v2.0/routers/4b252345-f758-472e-99df-5f8be3fcb13a HTTP/1.1" status: 204 len: 168 time: 1.2691448 May 26 14:47:47.092812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44746) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:47.292399 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_v2 [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Deleting subnet f9aad151-b793-4393-be42-7258cba2d2e6 {{(pid=98445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:47:47.295469 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:47.349340 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2677826'] for subnet, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:47.408975 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:47.749281 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-9851ce0a-6f60-4493-9250-24b96cfcb2e7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:47.750664 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-9851ce0a-6f60-4493-9250-24b96cfcb2e7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/networks?id=149051aa-2259-48fd-9599-39a44ad33762 HTTP/1.1" status: 200 len: 814 time: 0.2210574 May 26 14:47:47.772635 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-f4743746-609c-4d96-98bc-e221ed858459 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/quotas/d1a7192ff14647f894360c51e8ceac5b HTTP/1.1" status: 200 len: 375 time: 0.0156994 May 26 14:47:47.820774 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2332920', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2577448'] for subnet, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:47.831062 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-b7b618bf-307c-4155-8bda-c5337e362dc1 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=d1a7192ff14647f894360c51e8ceac5b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0514452 May 26 14:47:47.832560 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-642ae26d-948f-46e3-9211-abf57413e084 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:47.871861 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f9aad151-b793-4393-be42-7258cba2d2e6,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:47.875481 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:47.882469 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.882833 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.883210 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.883542 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.883882 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.884274 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.884626 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.884960 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.885299 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.885654 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.885968 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.886323 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:47.889762 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:47.892130 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-fed3e70f-5042-464e-bcde-36083e2bcdc1 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/f9aad151-b793-4393-be42-7258cba2d2e6 HTTP/1.1" status: 204 len: 168 time: 0.7974532 May 26 14:47:47.894052 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44768) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:48.028359 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:47:48.062790 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:47:48.062790 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 0b26b296-28ad-492a-9268-6d6f5e3fb2f1 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:47:48.063352 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d716edee-1b42-40f1-9df5-42382e808d45 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:47:48.079703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.097081 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: d716edee-1b42-40f1-9df5-42382e808d45 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:47:48.097416 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d716edee-1b42-40f1-9df5-42382e808d45 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:47:48.162427 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-e61fc2fc-331d-488b-9d09-eac56f01a39a service neutron] 10.222.0.72 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3037841 May 26 14:47:48.305195 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.327408 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d130e7f3-8552-49d7-bcfd-3db8c3289227']}} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:48.343196 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '31f0bd82-c79b-40bf-8404-580a8d30b406') {'for_net_delete': True} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:48.343432 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '31f0bd82-c79b-40bf-8404-580a8d30b406') {} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:48.366976 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2677883'] for segment, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.396771 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.400567 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-435e7879-f5f4-47b8-a2e3-ef8a0f527473 service neutron] 10.222.0.72 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2315269 May 26 14:47:48.405441 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Releasing vlan 1112 on physical network physnet1 to pool {{(pid=98445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:47:48.405759 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2334298'] for segment, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: Traceback (most recent call last): May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: timer() May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: cb(*args, **kw) May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: return func(*args, **kwargs) May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: self._notify() May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: self.callback(batched_events) May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: event.method(event) May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: return f(self, *a, **k) May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._get(url).json() May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: return self.request(url, 'GET', **kwargs) May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:47:48.419728 dv-cinder-774594-6-iscsi neutron-server[98445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:47:48.500053 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.503974 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cd4a4fd2-ee99-464c-88da-41c25a21da84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:48.525642 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.534011 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Pushing event deleted for resources: {'Network': ['ID=d130e7f3-8552-49d7-bcfd-3db8c3289227,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:48.537453 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:48.546725 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3c4965bf-e8b4-477e-b712-0b3579755c7a admin admin] 10.222.0.72 "DELETE /v2.0/networks/d130e7f3-8552-49d7-bcfd-3db8c3289227 HTTP/1.1" status: 204 len: 168 time: 0.6513877 May 26 14:47:48.601103 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-807a6963-b297-4d12-b61a-5585a2ab17a4 req-045323c2-f6ba-46e7-910e-356bf6d0ded6 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 210 time: 0.0455587 May 26 14:47:48.674144 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44790) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:48.731501 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-b98e5282-552d-4f92-b15d-712c5a45125a admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=ff8cee98b9cc47dd9a86993218bdede9&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0556777 May 26 14:47:48.734087 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44794) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:48.800076 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-40781cab-902f-488b-b366-f70c683b7a6f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.826951 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-40781cab-902f-488b-b366-f70c683b7a6f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.883151 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-40781cab-902f-488b-b366-f70c683b7a6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.887147 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-04d315ce-6160-4ec1-800e-923e27741721 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:48.903648 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40781cab-902f-488b-b366-f70c683b7a6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=549dea61-4498-4c30-b369-c50278775a2e,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:48.906883 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-40781cab-902f-488b-b366-f70c683b7a6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:48.916821 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-40781cab-902f-488b-b366-f70c683b7a6f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:48.920930 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-40781cab-902f-488b-b366-f70c683b7a6f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/549dea61-4498-4c30-b369-c50278775a2e HTTP/1.1" status: 204 len: 168 time: 0.1825523 May 26 14:47:49.753880 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-76b7e4d1-6ee9-44ea-8daa-78025d2d9515 req-a2b83418-fb55-4be8-ae40-6e043cb2df15 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 210 time: 0.0426838 May 26 14:47:50.267919 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-dcf17879-ebb5-4fe3-9d9e-8d736be2a7a9 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:50.269425 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-dcf17879-ebb5-4fe3-9d9e-8d736be2a7a9 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.79 "GET /v2.0/networks?id=149051aa-2259-48fd-9599-39a44ad33762 HTTP/1.1" status: 200 len: 814 time: 0.1832337 May 26 14:47:50.290997 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Request body: {'port': {'device_id': '10a83137-2800-40d3-a8bf-09ac94a9f881', 'network_id': '149051aa-2259-48fd-9599-39a44ad33762', 'admin_state_up': True, 'tenant_id': 'd1a7192ff14647f894360c51e8ceac5b'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:47:50.438416 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:50.442895 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Usage tracker for resource:port and tenant:d1a7192ff14647f894360c51e8ceac5b is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:50.445807 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:50.451789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:50.463377 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Made reservation on behalf of d1a7192ff14647f894360c51e8ceac5b for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:47:50.467656 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:50.645081 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf8a538d-5e5f-4e76-991d-b626952f2705 req-f1b8ccbe-8fc8-4b6d-9de9-50d33d176992 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:50.646761 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bf8a538d-5e5f-4e76-991d-b626952f2705 req-f1b8ccbe-8fc8-4b6d-9de9-50d33d176992 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 947 time: 0.1970057 May 26 14:47:50.647920 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Allocated IP 172.20.0.7 (149051aa-2259-48fd-9599-39a44ad33762/7943e8a1-ce31-4420-87bb-233f0b2070de/21777a95-a516-4d1b-9651-8cb80f5079e5) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:47:50.690474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44862) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:50.700825 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bf8a538d-5e5f-4e76-991d-b626952f2705 req-ec4448cb-eb5e-4d93-83ee-ac3430c2c810 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472276 May 26 14:47:50.818541 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:50.842458 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:50.846853 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Usage tracker for resource:security_group_rule and tenant:b5af352559094484aad4deabebd25a50 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:50.849875 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:50.856235 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:50.861705 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:50.893009 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:50.898621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-343a512e-0a29-4a61-aae7-f15745b73894 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:50.964150 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Network 149051aa-2259-48fd-9599-39a44ad33762 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:47:50.967353 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:47:50.971748 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:47:50.986409 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59747aa0-c211-45cf-9bc9-b3900ef15f23 req-c6387e6d-74f7-4507-958f-1ab2fd851933 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:50.987886 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-59747aa0-c211-45cf-9bc9-b3900ef15f23 req-c6387e6d-74f7-4507-958f-1ab2fd851933 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 931 time: 0.1195269 May 26 14:47:51.007750 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Pushing event updated for resources: {'Port': ['ID=21777a95-a516-4d1b-9651-8cb80f5079e5,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:51.012566 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:51.033101 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.041727 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:51.042380 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.043506 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.053605 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-88555481-bb4e-40a0-8293-410e95d48e43 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:51.069907 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7829406 May 26 14:47:51.071135 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-59747aa0-c211-45cf-9bc9-b3900ef15f23 req-6bbf78fd-3cf3-4b73-a8b8-a2576bc6afb2 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0729039 May 26 14:47:51.091116 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Request body: {'port': {'device_id': '10a83137-2800-40d3-a8bf-09ac94a9f881', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:47:51.099896 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=b5af352559094484aad4deabebd25a50&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4083161 May 26 14:47:51.101563 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba9dbc06-a153-4178-80b8-88f2e5795dfb,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:51.103912 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44870) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:51.106396 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:51.167624 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d00daafd-4897-4a8d-b2bb-8fa35ce837b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.196974 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d00daafd-4897-4a8d-b2bb-8fa35ce837b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.205025 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.253759 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d00daafd-4897-4a8d-b2bb-8fa35ce837b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.257695 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-678e4598-1137-4e85-99ee-bd5e35b3a818 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:51.268922 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00daafd-4897-4a8d-b2bb-8fa35ce837b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba9dbc06-a153-4178-80b8-88f2e5795dfb,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:51.272528 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d00daafd-4897-4a8d-b2bb-8fa35ce837b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:51.275990 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d00daafd-4897-4a8d-b2bb-8fa35ce837b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.278915 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-d00daafd-4897-4a8d-b2bb-8fa35ce837b7 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/ba9dbc06-a153-4178-80b8-88f2e5795dfb HTTP/1.1" status: 204 len: 168 time: 0.1739209 May 26 14:47:51.549303 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 21777a95-a516-4d1b-9651-8cb80f5079e5 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:47:51.557409 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.560834 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44878) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:51.572101 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Transition to ACTIVE for port object 21777a95-a516-4d1b-9651-8cb80f5079e5 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:47:51.576081 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.579831 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.580907 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-226eeed0-6e12-459f-b3b6-74e2586df52b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:51.594480 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:51.598289 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Usage tracker for resource:security_group_rule and tenant:dd8de334a7df4874ab0973fb84a6e641 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:51.601142 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:51.606999 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:51.640200 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-54f312c4-a25d-4aad-a788-e1615ec405a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.694558 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.699810 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.709060 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-89aae595-f3c9-4f40-9183-52672c84ee8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:51.738336 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Pushing event updated for resources: {'Port': ['ID=21777a95-a516-4d1b-9651-8cb80f5079e5,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:51.745291 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:51.748367 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=dd8de334a7df4874ab0973fb84a6e641&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1864777 May 26 14:47:51.749334 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04387d0d-dc81-4de9-8ad5-911a948660d2,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:51.751690 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44884) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:51.754073 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:51.812976 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Attempting to bind port 21777a95-a516-4d1b-9651-8cb80f5079e5 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:47:51.813301 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Attempting to bind port 21777a95-a516-4d1b-9651-8cb80f5079e5 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:47:51.813621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Attempting to bind port 21777a95-a516-4d1b-9651-8cb80f5079e5 on network 149051aa-2259-48fd-9599-39a44ad33762 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:47:51.817671 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-89cc90af-b158-43e8-8a2c-dfcb782ea1eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.818573 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Port 21777a95-a516-4d1b-9651-8cb80f5079e5 on network 149051aa-2259-48fd-9599-39a44ad33762 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:47:51.819071 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Attempting to bind port 21777a95-a516-4d1b-9651-8cb80f5079e5 on network 149051aa-2259-48fd-9599-39a44ad33762 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:47:51.824504 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 47, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:47:51.825010 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Checking segment: {'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:47:51.825603 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Bound using segment: {'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:47:51.826160 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Bound port: 21777a95-a516-4d1b-9651-8cb80f5079e5, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dbc923bc-953d-4379-ac99-a42c93117401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1133, 'network_id': '149051aa-2259-48fd-9599-39a44ad33762'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:47:51.826693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.846981 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-89cc90af-b158-43e8-8a2c-dfcb782ea1eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.964391 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48010c07-3910-42d0-8a6c-5f2666875e9b req-c1882799-2d5e-49bb-87a3-5f6870032bc4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:51.965985 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-48010c07-3910-42d0-8a6c-5f2666875e9b req-c1882799-2d5e-49bb-87a3-5f6870032bc4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 947 time: 0.1218719 May 26 14:47:51.967746 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-89cc90af-b158-43e8-8a2c-dfcb782ea1eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:51.976457 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6795b7cf-84e7-42ae-bf37-2084db09da45 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:52.001309 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] For port 21777a95-a516-4d1b-9651-8cb80f5079e5, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:47:52.004351 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] For port 21777a95-a516-4d1b-9651-8cb80f5079e5, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=21777a95-a516-4d1b-9651-8cb80f5079e5,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:47:52.008460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:52.008607 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89cc90af-b158-43e8-8a2c-dfcb782ea1eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04387d0d-dc81-4de9-8ad5-911a948660d2,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:52.013374 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-89cc90af-b158-43e8-8a2c-dfcb782ea1eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:52.013497 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:52.015334 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-89cc90af-b158-43e8-8a2c-dfcb782ea1eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:52.016429 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-89cc90af-b158-43e8-8a2c-dfcb782ea1eb admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/04387d0d-dc81-4de9-8ad5-911a948660d2 HTTP/1.1" status: 204 len: 168 time: 0.2638741 May 26 14:47:52.037401 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-48010c07-3910-42d0-8a6c-5f2666875e9b req-56a6545f-2b7f-4856-8b80-a4b9a4b63adb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0631113 May 26 14:47:52.072563 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:52.073170 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:52.074574 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] 10.222.0.79 "PUT /v2.0/ports/21777a95-a516-4d1b-9651-8cb80f5079e5 HTTP/1.1" status: 200 len: 1093 time: 0.9879918 May 26 14:47:52.075080 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '10a83137-2800-40d3-a8bf-09ac94a9f881', 'tag': '21777a95-a516-4d1b-9651-8cb80f5079e5'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:47:52.103454 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Pushing event updated for resources: {'Port': ['ID=21777a95-a516-4d1b-9651-8cb80f5079e5,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:52.107546 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:52.145128 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '10a83137-2800-40d3-a8bf-09ac94a9f881', 'tag': '21777a95-a516-4d1b-9651-8cb80f5079e5', 'status': 'completed', 'code': 200} May 26 14:47:52.265998 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-8dad2b20-6dd9-472c-ba7a-15fb50e2bf4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:52.267912 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-8dad2b20-6dd9-472c-ba7a-15fb50e2bf4d service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=d1a7192ff14647f894360c51e8ceac5b&device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 1096 time: 0.0798604 May 26 14:47:52.276041 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69321078-540e-4f8c-931a-ff0703784ddd req-9e5239f5-54c8-472b-be70-e20bf153e613 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:52.277536 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-69321078-540e-4f8c-931a-ff0703784ddd req-9e5239f5-54c8-472b-be70-e20bf153e613 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 943 time: 0.0875664 May 26 14:47:52.322798 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-69321078-540e-4f8c-931a-ff0703784ddd req-da8f725e-c87c-42c0-98c3-532cee79ba76 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392284 May 26 14:47:52.351997 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-afebf2b2-d824-4f4f-a639-8587c58ed222 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=21777a95-a516-4d1b-9651-8cb80f5079e5 HTTP/1.1" status: 200 len: 217 time: 0.0670869 May 26 14:47:52.414984 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-aa6f2a88-291e-44a6-818d-83259441f8dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:52.416483 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-aa6f2a88-291e-44a6-818d-83259441f8dd service neutron] 10.222.0.79 "GET /v2.0/subnets?id=7943e8a1-ce31-4420-87bb-233f0b2070de HTTP/1.1" status: 200 len: 854 time: 0.0571706 May 26 14:47:52.481538 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-389b5fda-ec62-4647-9bda-9a914ceb3f33 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=149051aa-2259-48fd-9599-39a44ad33762&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0444508 May 26 14:47:52.522108 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-723a862e-893c-46d3-98de-9ff0b61f4026 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:52.523492 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-723a862e-893c-46d3-98de-9ff0b61f4026 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 947 time: 0.0866234 May 26 14:47:52.618202 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-b1a487e3-faa1-4d64-8adf-43763314cf57 service neutron] 10.222.0.79 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1288636 May 26 14:47:52.671209 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Deleting port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:47:52.671547 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:52.768485 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-21c6cc42-53d9-41ce-b247-20e901b65e79 req-f0adb3c1-90a1-46f1-ab12-1483922ae23e service neutron] 10.222.0.79 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1432631 May 26 14:47:52.810864 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] For port 8553a1c9-db24-4d4f-8d37-0a358f73ac23, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=8553a1c9-db24-4d4f-8d37-0a358f73ac23,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:52.811479 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:52.942113 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-d39461ea-9e67-4692-8f46-5750de93513a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:52.943634 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-d39461ea-9e67-4692-8f46-5750de93513a service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=d1a7192ff14647f894360c51e8ceac5b&device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 1096 time: 0.0750811 May 26 14:47:53.099349 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-e61888cf-3302-4419-a523-66333fcd9acd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:53.101504 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-e61888cf-3302-4419-a523-66333fcd9acd service neutron] 10.222.0.79 "GET /v2.0/networks?id=149051aa-2259-48fd-9599-39a44ad33762 HTTP/1.1" status: 200 len: 916 time: 0.1499424 May 26 14:47:53.127945 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:53.128545 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:53.129029 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.l3_db [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Floating IP 986379f1-3866-4361-8ca4-51d02f9acf86 disassociated. External IP: 172.27.3.98, port: 8553a1c9-db24-4d4f-8d37-0a358f73ac23. May 26 14:47:53.129505 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Calling delete_port for 8553a1c9-db24-4d4f-8d37-0a358f73ac23 owned by compute:nova {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:47:53.193086 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-703cd4e8-fa88-48d4-8cd9-3d999de33c79 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=21777a95-a516-4d1b-9651-8cb80f5079e5 HTTP/1.1" status: 200 len: 217 time: 0.0838122 May 26 14:47:53.265240 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-666153a6-4cff-4e24-ac49-bff4e902d5fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:53.275231 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-bdf6aedf-d321-4334-8d7b-b86addaac053 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:53.277019 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-bdf6aedf-d321-4334-8d7b-b86addaac053 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=7943e8a1-ce31-4420-87bb-233f0b2070de HTTP/1.1" status: 200 len: 854 time: 0.0765338 May 26 14:47:53.317397 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a1e09f-86b3-4f1f-a07f-f12c74ab1695 req-c54a0e01-a180-47dc-9726-6881bee72a20 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:53.318773 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-85a1e09f-86b3-4f1f-a07f-f12c74ab1695 req-c54a0e01-a180-47dc-9726-6881bee72a20 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=f6b718ad-b292-497c-b3b7-8d7205656364 HTTP/1.1" status: 200 len: 947 time: 0.1409340 May 26 14:47:53.319851 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:53.326115 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:53.332976 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-4ae31585-e777-446e-bc7d-5e826167489f service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=149051aa-2259-48fd-9599-39a44ad33762&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0473809 May 26 14:47:53.387470 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event deleted for resources: {'Port': ['ID=8553a1c9-db24-4d4f-8d37-0a358f73ac23,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:53.398043 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:53.487209 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-2977d332-9ed7-42f7-a31d-6665875789d0 service neutron] 10.222.0.79 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1454453 May 26 14:47:53.629850 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-52d6c53e-7076-4918-8e54-d9dec2ce049d req-8cea2ca7-3a9a-4ba1-a5d8-fa580335bf90 service neutron] 10.222.0.79 "GET /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1361084 May 26 14:47:53.630976 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-85a1e09f-86b3-4f1f-a07f-f12c74ab1695 req-e8a3b8a8-3a80-4def-925b-c65de660cde1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=415194a2-fecb-4491-adab-dcc03a38f19c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2667835 May 26 14:47:53.760071 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Router f62ef884-b65a-487d-8955-15d95245398f has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:47:53.768021 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb718558-3df9-4a34-b47c-d24b2b8d9201 req-903ade5d-1fd5-4e83-9db8-c517fc941010 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:53.769518 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cb718558-3df9-4a34-b47c-d24b2b8d9201 req-903ade5d-1fd5-4e83-9db8-c517fc941010 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 943 time: 0.2112556 May 26 14:47:53.881232 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:53.894695 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cb718558-3df9-4a34-b47c-d24b2b8d9201 req-ee86e7a7-767b-4a3c-9b52-05692ceed96a tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1185465 May 26 14:47:53.990256 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:47:54.003664 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] Sync routers for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:47:54.014118 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:47:54.017348 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:47:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:54.082995 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] No DVR routers for this DVR port 8553a1c9-db24-4d4f-8d37-0a358f73ac23 on host hv-cinder-77459 {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:47:54.086357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:54.089197 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-deleted', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:47:54.109547 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e00762c8-53cc-4dde-b5c0-4b725bc51fef req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "DELETE /v2.0/ports/8553a1c9-db24-4d4f-8d37-0a358f73ac23 HTTP/1.1" status: 204 len: 173 time: 1.5797677 May 26 14:47:54.145946 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f6b718ad-b292-497c-b3b7-8d7205656364', 'name': 'network-vif-deleted', 'tag': '8553a1c9-db24-4d4f-8d37-0a358f73ac23', 'status': 'completed', 'code': 200} May 26 14:47:54.253567 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:47:54.532096 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 21777a95-a516-4d1b-9651-8cb80f5079e5 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:47:54.615596 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:54.718540 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:54.735028 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] Checking router: f62ef884-b65a-487d-8955-15d95245398f for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:47:54.752417 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 21777a95-a516-4d1b-9651-8cb80f5079e5, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=21777a95-a516-4d1b-9651-8cb80f5079e5,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:54.759628 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:47:54.760261 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:47:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:54.812689 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 44996) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:54.871223 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '21777a95-a516-4d1b-9651-8cb80f5079e5', 'network_id': '149051aa-2259-48fd-9599-39a44ad33762', 'port_id': '21777a95-a516-4d1b-9651-8cb80f5079e5', 'mac_address': 'fa:16:3e:de:2c:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7943e8a1-ce31-4420-87bb-233f0b2070de', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:47:54.884345 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ee3f57a0-951e-4378-aed9-edb2b889111e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:54.916068 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ee3f57a0-951e-4378-aed9-edb2b889111e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:54.977749 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ee3f57a0-951e-4378-aed9-edb2b889111e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:54.985516 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-2ec90b74-993a-4e2b-a352-aac327bc5558 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:55.010395 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3f57a0-951e-4378-aed9-edb2b889111e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=415194a2-fecb-4491-adab-dcc03a38f19c,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:55.013194 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ee3f57a0-951e-4378-aed9-edb2b889111e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:55.033609 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ee3f57a0-951e-4378-aed9-edb2b889111e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:55.036404 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-ee3f57a0-951e-4378-aed9-edb2b889111e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "DELETE /v2.0/security-groups/415194a2-fecb-4491-adab-dcc03a38f19c HTTP/1.1" status: 204 len: 168 time: 0.2223310 May 26 14:47:55.039296 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45020) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:55.055257 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:55.083196 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:47:55.113668 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.api.v2.resource [None req-acbcbf8c-682b-4da8-9143-b219cc148cf7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] show failed (client error): The resource could not be found. May 26 14:47:55.114799 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-acbcbf8c-682b-4da8-9143-b219cc148cf7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups/415194a2-fecb-4491-adab-dcc03a38f19c HTTP/1.1" status: 404 len: 347 time: 0.0745020 May 26 14:47:55.117835 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45026) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:55.129177 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 21777a95-a516-4d1b-9651-8cb80f5079e5 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:47:55.171751 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 21777a95-a516-4d1b-9651-8cb80f5079e5, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=21777a95-a516-4d1b-9651-8cb80f5079e5,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:55.178968 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e1684b-4c53-48bf-afb1-9ffba1126e8a req-42e5174b-3f19-4a37-b6aa-52d9b2b83f11 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:55.187931 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e6e1684b-4c53-48bf-afb1-9ffba1126e8a req-42e5174b-3f19-4a37-b6aa-52d9b2b83f11 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 943 time: 0.1253579 May 26 14:47:55.217779 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:47:55.236276 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:55.252042 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:55.266283 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e6e1684b-4c53-48bf-afb1-9ffba1126e8a req-22dbddfe-750f-43cb-a9b3-a0a890e388aa tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773506 May 26 14:47:55.515259 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=21777a95-a516-4d1b-9651-8cb80f5079e5,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:55.523612 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.524066 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.524489 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.525020 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.525520 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.525880 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.526295 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.526731 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.527140 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.527664 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.527957 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.528334 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:47:55.540846 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:55.559824 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Deleting port 6677c60d-aed9-42fd-90c5-2213e82d84f4 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:47:55.560219 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:55.578709 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:47:55.584281 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4554dd0f-9dc9-46d4-9562-6ef631e233fe None None] The sync data for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi is: [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:47:55.635070 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['21777a95-a516-4d1b-9651-8cb80f5079e5'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:47:55.699361 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:55.699627 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:55.899956 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Calling delete_port for 6677c60d-aed9-42fd-90c5-2213e82d84f4 owned by network:floatingip {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:47:55.902486 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:55.934755 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f15cdd9-9abf-4b88-b45b-51e239085557 None None] New status for floating IP 986379f1-3866-4361-8ca4-51d02f9acf86: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:47:55.979880 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45048) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:56.045886 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.052262 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4ca14317-61a1-49b4-a7ee-e9a1245b8b92 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:56.104144 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event deleted for resources: {'Port': ['ID=6677c60d-aed9-42fd-90c5-2213e82d84f4,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:56.110154 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.db.api [None req-2f15cdd9-9abf-4b88-b45b-51e239085557 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=98447) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 26 14:47:56.110582 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_db.api [None req-2f15cdd9-9abf-4b88-b45b-51e239085557 None None] Performing DB retry for function neutron.api.rpc.handlers.l3_rpc.L3RpcCallback.update_floatingip_statuses {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 26 14:47:56.111828 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:56.125259 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.141304 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:56.145387 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Usage tracker for resource:security_group_rule and tenant:5878dd41888f46a09d00ff9aaf734073 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:56.148423 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:56.154140 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:56.204984 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.218937 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.223313 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "DELETE /v2.0/floatingips/986379f1-3866-4361-8ca4-51d02f9acf86 HTTP/1.1" status: 204 len: 168 time: 1.1029198 May 26 14:47:56.244613 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.249742 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.258057 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a4d51ace-86f7-4a9b-b7e9-af24f059b303 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:56.300758 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=5878dd41888f46a09d00ff9aaf734073&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3168554 May 26 14:47:56.301203 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=126bed23-7194-4c34-a73a-44b44c259443,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:56.302289 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45058) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:56.355164 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:56.370970 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-74cdc4a3-0421-4206-86b3-5ac646968c36 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.386968 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-085e0dc8-21b3-4ffa-a3bd-895289176243 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0872498 May 26 14:47:56.397353 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-74cdc4a3-0421-4206-86b3-5ac646968c36 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.430439 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 21777a95-a516-4d1b-9651-8cb80f5079e5 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:47:56.456615 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-74cdc4a3-0421-4206-86b3-5ac646968c36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.462612 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-482b4edd-0518-416c-851b-a6605b51de01 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:56.474895 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74cdc4a3-0421-4206-86b3-5ac646968c36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=126bed23-7194-4c34-a73a-44b44c259443,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:56.478936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-74cdc4a3-0421-4206-86b3-5ac646968c36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:56.482316 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-74cdc4a3-0421-4206-86b3-5ac646968c36 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.485971 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-74cdc4a3-0421-4206-86b3-5ac646968c36 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/126bed23-7194-4c34-a73a-44b44c259443 HTTP/1.1" status: 204 len: 168 time: 0.1798942 May 26 14:47:56.527357 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 21777a95-a516-4d1b-9651-8cb80f5079e5 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:47:56.533224 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 21777a95-a516-4d1b-9651-8cb80f5079e5 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:47:56.533825 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.566401 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-0818638b-b495-48bc-af2a-19a043ed3ffb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:56.568118 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-0818638b-b495-48bc-af2a-19a043ed3ffb service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 1098 time: 0.1342337 May 26 14:47:56.579606 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ae63bc-d7ef-48f1-892b-b61afffe9fd8 req-8d95ca74-985c-47a5-8ab3-d5597f95e8e5 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:56.585985 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c5ae63bc-d7ef-48f1-892b-b61afffe9fd8 req-8d95ca74-985c-47a5-8ab3-d5597f95e8e5 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 944 time: 0.1860876 May 26 14:47:56.611951 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f15cdd9-9abf-4b88-b45b-51e239085557 None None] New status for floating IP 986379f1-3866-4361-8ca4-51d02f9acf86: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:47:56.707410 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.742732 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '10a83137-2800-40d3-a8bf-09ac94a9f881', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '21777a95-a516-4d1b-9651-8cb80f5079e5'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:47:56.755201 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 21777a95-a516-4d1b-9651-8cb80f5079e5, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=21777a95-a516-4d1b-9651-8cb80f5079e5,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:56.762957 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.764070 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:47:56.772384 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-3ac4cdb8-1231-4644-a7a0-c24492d8c543 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:56.774106 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-3ac4cdb8-1231-4644-a7a0-c24492d8c543 service neutron] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 913 time: 0.1658134 May 26 14:47:56.800602 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-3f81a227-11f9-4d84-9b4b-57a5a3a5a50a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:56.822847 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45072) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:56.829823 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'security_group': {'name': 'tempest-securitygroup--274137532', 'description': 'tempest-description--923048832'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:47:56.841494 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:56.851840 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:security_group and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:56.856679 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:56.870972 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:56.891517 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:56.894749 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=21777a95-a516-4d1b-9651-8cb80f5079e5,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:56.898969 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 8553a1c9-db24-4d4f-8d37-0a358f73ac23 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:47:56.899500 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 8553a1c9-db24-4d4f-8d37-0a358f73ac23 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:47:56.901038 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:56.911404 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '10a83137-2800-40d3-a8bf-09ac94a9f881', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '21777a95-a516-4d1b-9651-8cb80f5079e5', 'code': 200} May 26 14:47:56.919996 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:56.923921 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:security_group_rule and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:56.927131 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:56.941984 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c5ae63bc-d7ef-48f1-892b-b61afffe9fd8 req-6eb71d4d-366b-4075-9a60-87d9ddf5d463 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3535049 May 26 14:47:56.944115 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:56.985733 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45076) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:57.008274 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-3101786f-6a80-456c-afea-9dc2bb19c271 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0 HTTP/1.1" status: 200 len: 1001 time: 0.2264760 May 26 14:47:57.017235 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.043586 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:57.056068 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Usage tracker for resource:security_group_rule and tenant:16bff621c4754054b486f4249b6e944f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:57.060236 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.061286 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:57.068830 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:57.071437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.074837 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-c32a4a9b-abd8-43cc-bf68-b5f341ac871a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:57.076463 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-c32a4a9b-abd8-43cc-bf68-b5f341ac871a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.0611603 May 26 14:47:57.077129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fe6f7880-91e3-4c9c-bc30-e43457c7be0a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:57.184364 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.185569 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.3616309 May 26 14:47:57.186573 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e8c42ca2-93cf-4598-951c-cdf06028ae80,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:57.189410 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45080) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:57.191077 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:57.197184 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'security_group_rule': {'security_group_id': 'e8c42ca2-93cf-4598-951c-cdf06028ae80', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:47:57.258378 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f34625d9-c989-4281-b627-2de71d5bd1b8 req-f7f66222-8363-4985-8987-b0b6121708b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:57.260048 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f34625d9-c989-4281-b627-2de71d5bd1b8 req-f7f66222-8363-4985-8987-b0b6121708b8 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 1098 time: 0.1348283 May 26 14:47:57.296410 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.308325 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.314962 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:57.316754 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-aea8f5af-340c-4809-9344-901ddae6f5fe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:57.318879 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-f8d1dca0-dfa2-4ded-ba3e-4a73753eb886 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:57.320468 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-f8d1dca0-dfa2-4ded-ba3e-4a73753eb886 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2013056 May 26 14:47:57.322969 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:security_group_rule and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:57.326044 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:57.346095 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-f34625d9-c989-4281-b627-2de71d5bd1b8 req-39c60861-2cb0-4fc5-b44f-12c4e4c6f728 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731311 May 26 14:47:57.351449 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:57.366355 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=16bff621c4754054b486f4249b6e944f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3771257 May 26 14:47:57.366649 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45084) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:57.369467 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fcfe6c1-fcbe-4858-ad98-6b2f3b4f98e6,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:57.382940 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:57.427404 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.434979 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b5dfd62f-4c61-4c1b-997f-24c3edcca8db admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.465985 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b5dfd62f-4c61-4c1b-997f-24c3edcca8db admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.469072 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.505902 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-6fd43b09-9433-4c55-9be5-fd42e19c71ff service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1762545 May 26 14:47:57.519912 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b5dfd62f-4c61-4c1b-997f-24c3edcca8db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.523841 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a8691791-9673-4b5f-9f90-8a612317a47b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:57.525007 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.529724 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.531929 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:57.536441 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5dfd62f-4c61-4c1b-997f-24c3edcca8db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fcfe6c1-fcbe-4858-ad98-6b2f3b4f98e6,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:57.541510 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b5dfd62f-4c61-4c1b-997f-24c3edcca8db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:57.543215 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b5dfd62f-4c61-4c1b-997f-24c3edcca8db admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.546029 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b5dfd62f-4c61-4c1b-997f-24c3edcca8db admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/7fcfe6c1-fcbe-4858-ad98-6b2f3b4f98e6 HTTP/1.1" status: 204 len: 168 time: 0.1767342 May 26 14:47:57.556816 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fffafd35-eacb-4a39-a20e-073f19e2b8e6,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:57.565147 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:57.579175 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.580369 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f072a459-5b86-412f-acd6-cde8f85d3c54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3895655 May 26 14:47:57.583119 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45092) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:57.588285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'security_group_rule': {'security_group_id': 'e8c42ca2-93cf-4598-951c-cdf06028ae80', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:47:57.594047 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:57.597837 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:security_group_rule and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:57.600725 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:57.607221 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:57.623024 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.830272 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.833775 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-f0ba7414-b4b1-4b6b-bc3c-01a82e0c3e85 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1257580482&fields=id&tenant_id=3defae92a9a1480c9278cae3445f9617 HTTP/1.1" status: 200 len: 267 time: 0.1027131 May 26 14:47:57.836548 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.842011 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2e1bc26-fd66-4ac2-86fd-1f6f1ede5f29 req-5053a6b5-5cf5-4562-a2f0-5bfa7df8c31c service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2120275 May 26 14:47:57.847022 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:57.905197 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0eb6e00-b53e-4220-a784-ecc5329e246c,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:57.915439 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:57.930518 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:57.931763 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3476181 May 26 14:47:57.934947 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45106) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:57.941508 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:47:57.950067 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:47:57.956831 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Usage tracker for resource:floatingip and tenant:f2b58b2245f643ac9193934fdab405c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:47:57.960447 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:47:57.969237 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:47:57.991158 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-8ffa296b-774f-49a8-8713-3e7f739e4012 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:57.992656 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-8ffa296b-774f-49a8-8713-3e7f739e4012 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 984 time: 0.1465497 May 26 14:47:57.994017 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:58.016897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Request body: {'port': {'security_groups': ['11048e68-75a2-4529-93aa-c6555fbd1fe1']}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:47:58.267906 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:58.361294 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff3c3bd-d74b-4f4b-83ce-ab1e671746e6 req-8f22e874-c092-4d48-822e-a25a36d831f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:58.362813 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cff3c3bd-d74b-4f4b-83ce-ab1e671746e6 req-8f22e874-c092-4d48-822e-a25a36d831f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 945 time: 0.2937779 May 26 14:47:58.463751 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cff3c3bd-d74b-4f4b-83ce-ab1e671746e6 req-a34ad3b4-81f3-49d0-88fc-96291918ad8d tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816228 May 26 14:47:58.468207 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:58.719728 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] For port ac07176b-6df8-402b-be15-ef2328d925a9, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ac07176b-6df8-402b-be15-ef2328d925a9,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:47:58.738696 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Allocated IP 172.27.3.219 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/13857025-e968-40b6-ab0b-8298ae3b136c) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:47:58.782920 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:58.789800 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:58.829478 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ac07176b-6df8-402b-be15-ef2328d925a9'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:47:58.843333 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:58.969716 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:58.970465 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:58.971899 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-902c2ab8-6153-46b3-983e-255dd5a56f46 req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "PUT /v2.0/ports/ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 942 time: 0.9646220 May 26 14:47:58.978794 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:47:58.979930 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45144) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:59.028720 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event updated for resources: {'Port': ['ID=ac07176b-6df8-402b-be15-ef2328d925a9,revision_number=7']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:59.057478 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-528a039d-762a-4991-ab2d-92d3e3f10333 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:59.065564 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'status': 'completed', 'code': 200} May 26 14:47:59.086578 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.094018 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-11af0395-0d98-49b7-911d-25cb3ff9985c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.107994 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-308bdcaf-bc88-4f4e-9be5-8544033a099b req-5007f676-70a0-423b-bc81-6093746e40e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:59.109906 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-308bdcaf-bc88-4f4e-9be5-8544033a099b req-5007f676-70a0-423b-bc81-6093746e40e4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.2713094 May 26 14:47:59.148603 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-11af0395-0d98-49b7-911d-25cb3ff9985c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.186108 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ac07176b-6df8-402b-be15-ef2328d925a9'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:47:59.270714 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-11af0395-0d98-49b7-911d-25cb3ff9985c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.278132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5206d54e-4db2-4e18-a48f-b36d48aa8dcb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:59.298406 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11af0395-0d98-49b7-911d-25cb3ff9985c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:59.307890 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-11af0395-0d98-49b7-911d-25cb3ff9985c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:59.316741 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-11af0395-0d98-49b7-911d-25cb3ff9985c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.335025 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-11af0395-0d98-49b7-911d-25cb3ff9985c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "DELETE /v2.0/security-groups/f6890f1d-2b3c-4a95-bbb6-f8a6588c1af9 HTTP/1.1" status: 204 len: 168 time: 0.3531106 May 26 14:47:59.336038 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45156) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:47:59.366529 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-308bdcaf-bc88-4f4e-9be5-8544033a099b req-7b06f1fd-23e6-47ce-bded-e8d20ec7ff9d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2459626 May 26 14:47:59.394371 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.399452 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:47:59.402530 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-62bf7b2c-261d-4825-929a-e1c577022ca8 None None] Provisioning complete for port ac07176b-6df8-402b-be15-ef2328d925a9 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:47:59.402903 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-62bf7b2c-261d-4825-929a-e1c577022ca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.482111 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:47:59.485878 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:47:59.495935 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:47:59.555138 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-13b1358f-4a19-4c35-84fd-e8a384e98461 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:59.556709 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-13b1358f-4a19-4c35-84fd-e8a384e98461 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3defae92a9a1480c9278cae3445f9617&device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1098 time: 0.4375455 May 26 14:47:59.557392 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'Port': ['ID=13857025-e968-40b6-ab0b-8298ae3b136c,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:47:59.567129 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:47:59.677673 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Deleting port 9a71da7e-bd23-4f38-95b4-89d8516732e5 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:47:59.678002 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.832540 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-1160e1bd-8eb3-40cc-bba4-37448a7b0597 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:59.834020 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-1160e1bd-8eb3-40cc-bba4-37448a7b0597 service neutron] 10.222.0.79 "GET /v2.0/networks?id=f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 200 len: 917 time: 0.2681665 May 26 14:47:59.835174 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.909546 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.909915 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:47:59.932010 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559c0753-ba99-4944-ad9c-80cbbd14d680 req-7a711a91-622e-45ee-9f07-a3749d780a4f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:47:59.933511 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-559c0753-ba99-4944-ad9c-80cbbd14d680 req-7a711a91-622e-45ee-9f07-a3749d780a4f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 945 time: 0.2738237 May 26 14:48:00.035407 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-6b70e40e-2521-475f-b061-a5698ff00b63 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 1001 time: 0.1931787 May 26 14:48:00.053116 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Calling delete_port for 9a71da7e-bd23-4f38-95b4-89d8516732e5 owned by network:floatingip {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:00.073630 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:00.114184 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-559c0753-ba99-4944-ad9c-80cbbd14d680 req-9dfa32f1-e74b-4f7d-b514-3b1cd402719b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1411457 May 26 14:48:00.166189 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-38d8dc9d-3db9-4b67-aaed-f5d6e9e80937 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:00.167683 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-38d8dc9d-3db9-4b67-aaed-f5d6e9e80937 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=466228a3-069c-4ecc-9790-37e83a8604c9 HTTP/1.1" status: 200 len: 854 time: 0.1257813 May 26 14:48:00.197141 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:00.202098 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-065eb236-71ae-458a-989c-3d90c2e571f7 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:00.247940 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event deleted for resources: {'Port': ['ID=9a71da7e-bd23-4f38-95b4-89d8516732e5,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:00.251280 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:00.348215 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-fbe61666-6a40-468d-8741-3d493c624e4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:00.348932 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks [] for floatingip, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:00.349373 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Floating IP 06e9f647-add0-41cb-bb0f-18fb54b727f7 disassociated (deleted). External IP: 172.27.3.108, port: ac07176b-6df8-402b-be15-ef2328d925a9. May 26 14:48:00.349894 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-fbe61666-6a40-468d-8741-3d493c624e4e service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=f37261a9-5fa8-47e1-88e3-772578212058&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1660213 May 26 14:48:00.394395 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:00.447834 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:00.454705 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:00.649554 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'Port': ['ID=13857025-e968-40b6-ab0b-8298ae3b136c,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:00.664372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:00.671018 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:00.681896 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-b8a1692b-9aa7-4afc-b76f-f7a83a86ac26 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3131626 May 26 14:48:00.760504 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Router 7cd46f66-75af-44f8-b523-9201f57ddbda has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:48:00.772443 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:00.773660 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.8375921 May 26 14:48:00.800444 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3a82df-7bd7-42d4-b1b0-4db00162e2d9 req-dbd1ea91-acbc-4599-a819-5aabaf3554a4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:00.801881 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6e3a82df-7bd7-42d4-b1b0-4db00162e2d9 req-dbd1ea91-acbc-4599-a819-5aabaf3554a4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.3031487 May 26 14:48:00.965821 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:48:00.984788 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] Sync routers for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:48:00.998641 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:00.999294 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:47:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:01.003743 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-13ce3097-7b2a-4876-ba66-b1d3e23cd69d req-245e63d7-0b5d-41aa-838b-b724962cad43 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3159578 May 26 14:48:01.020565 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6e3a82df-7bd7-42d4-b1b0-4db00162e2d9 req-12bbd9bb-d6c5-4940-ae89-5604796b3011 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2040153 May 26 14:48:01.026415 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:01.090276 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "DELETE /v2.0/floatingips/06e9f647-add0-41cb-bb0f-18fb54b727f7 HTTP/1.1" status: 204 len: 168 time: 1.7521150 May 26 14:48:01.091036 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:01.147348 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-9062cc7e-b51a-4c60-9d12-aebeb3fffa1a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Synchronizing usage tracker for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:48:01.175795 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-9062cc7e-b51a-4c60-9d12-aebeb3fffa1a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Unset dirty status for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:48:01.176885 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-9062cc7e-b51a-4c60-9d12-aebeb3fffa1a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-securitygroup--274137532&fields=id&tenant_id=f2b58b2245f643ac9193934fdab405c5 HTTP/1.1" status: 200 len: 267 time: 0.1293802 May 26 14:48:01.189019 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-d36805f3-efbb-4bde-8d79-142279e6fe30 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:01.190484 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-d36805f3-efbb-4bde-8d79-142279e6fe30 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.1442070 May 26 14:48:01.255672 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:01.442751 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-692b683d-1285-4661-8155-189e4b1bde70 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:01.445165 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-692b683d-1285-4661-8155-189e4b1bde70 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 816 time: 0.2537560 May 26 14:48:01.464392 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-c6a51979-7b38-4441-bd08-21256bd40352 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/quotas/f2b58b2245f643ac9193934fdab405c5 HTTP/1.1" status: 200 len: 375 time: 0.0148633 May 26 14:48:01.530691 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Deleting port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:01.531031 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:01.615899 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:22Z', 'revision_number': 5, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:01.620629 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] Checking router: 7cd46f66-75af-44f8-b523-9201f57ddbda for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:48:01.630833 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:01.631456 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:47:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:01.688187 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-71a5a5d9-4297-49c2-a6cd-ad975a23a351 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Synchronizing usage tracker for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:48:01.704707 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] For port 0ecd487f-30b4-4cc4-b331-76c06312e6b0, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=0ecd487f-30b4-4cc4-b331-76c06312e6b0,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:01.705060 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:01.732467 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'status': 'completed', 'code': 200} May 26 14:48:01.772852 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-71a5a5d9-4297-49c2-a6cd-ad975a23a351 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Unset dirty status for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:48:01.774165 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-71a5a5d9-4297-49c2-a6cd-ad975a23a351 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3028846 May 26 14:48:01.852226 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:02.086059 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-ce13fb35-ae0e-4c7a-b572-fe7e7ea728ce service neutron] 10.222.0.72 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2925639 May 26 14:48:02.176724 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:22Z', 'revision_number': 5, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:02.183608 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd00a013-fd53-42a7-a12e-93096bd7314d None None] The sync data for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi is: [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:44:12Z', 'revision_number': 4, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd256d0f7-b3e5-470b-9049-adf3e1632cbc', 'name': '', 'network_id': 'f37261a9-5fa8-47e1-88e3-772578212058', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'mac_address': 'fa:16:3e:f6:d7:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_interface', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:12Z', 'updated_at': '2021-05-26T14:44:22Z', 'revision_number': 5, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'subnets': [{'id': '466228a3-069c-4ecc-9790-37e83a8604c9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:48:02.229199 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:02.229839 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:02.229839 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.l3_db [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Floating IP 79494d40-36bf-43b0-96dc-800598e41e2f disassociated. External IP: 172.27.3.238, port: 0ecd487f-30b4-4cc4-b331-76c06312e6b0. May 26 14:48:02.230166 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Calling delete_port for 0ecd487f-30b4-4cc4-b331-76c06312e6b0 owned by compute:nova {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:02.324941 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-b5e35fcf-42a1-44be-a1af-a2504bcc2796 service neutron] 10.222.0.72 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2266088 May 26 14:48:02.351714 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a24e237-51b8-4028-982c-54880ae2a45c req-44eec02e-ad68-413e-b76d-2ec9010873e1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:02.353255 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0a24e237-51b8-4028-982c-54880ae2a45c req-44eec02e-ad68-413e-b76d-2ec9010873e1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 945 time: 0.2236035 May 26 14:48:02.422374 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e954be03-d586-4f75-bdc2-bc53ddc13e49 None None] New status for floating IP 06e9f647-add0-41cb-bb0f-18fb54b727f7: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:48:02.471081 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0a24e237-51b8-4028-982c-54880ae2a45c req-b4b6f4ab-3bdd-4d25-8150-408e6fdf6834 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=885c9e1a-12b0-4463-9740-2b7fe71b6599&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1108673 May 26 14:48:02.503240 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:02.509229 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:02.553637 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event deleted for resources: {'Port': ['ID=0ecd487f-30b4-4cc4-b331-76c06312e6b0,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:02.557410 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:02.810815 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-02d5ff21-6878-47e1-814e-efd962752d76 req-50a4bd28-9eb4-4c6b-9819-a964e4b6f779 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 210 time: 0.0529587 May 26 14:48:02.921832 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Router 3865f36a-0ff1-4ceb-997f-e7f4306675ef has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:48:03.116169 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:48:03.126005 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81556065-f887-4714-a400-6800a28d6772 None None] Sync routers for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:48:03.136293 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81556065-f887-4714-a400-6800a28d6772 None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:03.136897 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-81556065-f887-4714-a400-6800a28d6772 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:47:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:03.187781 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] No DVR routers for this DVR port 0ecd487f-30b4-4cc4-b331-76c06312e6b0 on host hv-cinder-77459 {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:48:03.190483 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:03.193121 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'name': 'network-vif-deleted', 'tag': '0ecd487f-30b4-4cc4-b331-76c06312e6b0'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:03.206269 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bf13e11b-b0f6-4480-abc5-42734ac125bd req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "DELETE /v2.0/ports/0ecd487f-30b4-4cc4-b331-76c06312e6b0 HTTP/1.1" status: 204 len: 173 time: 1.9917138 May 26 14:48:03.238813 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c0b9a5b8-6c60-41c6-8785-d47a9ed0d257', 'name': 'network-vif-deleted', 'tag': '0ecd487f-30b4-4cc4-b331-76c06312e6b0', 'status': 'completed', 'code': 200} May 26 14:48:03.315690 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-81556065-f887-4714-a400-6800a28d6772 None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:03.630455 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-c9134bb0-a51e-41d9-944a-84b91b45aa7b req-33097833-75d7-42a0-b21e-0552a1f17b14 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Synchronizing usage tracker for tenant:c906c656a3474e64ab918724c042f2be on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:48:03.649070 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-c9134bb0-a51e-41d9-944a-84b91b45aa7b req-33097833-75d7-42a0-b21e-0552a1f17b14 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Unset dirty status for tenant:c906c656a3474e64ab918724c042f2be on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:48:03.650350 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c9134bb0-a51e-41d9-944a-84b91b45aa7b req-33097833-75d7-42a0-b21e-0552a1f17b14 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 210 time: 0.0661619 May 26 14:48:03.663386 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-81556065-f887-4714-a400-6800a28d6772 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:03.667629 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81556065-f887-4714-a400-6800a28d6772 None None] Checking router: 3865f36a-0ff1-4ceb-997f-e7f4306675ef for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:48:03.675767 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81556065-f887-4714-a400-6800a28d6772 None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:03.676363 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-81556065-f887-4714-a400-6800a28d6772 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:47:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:03.853719 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-81556065-f887-4714-a400-6800a28d6772 None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:03.979769 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3899e3d2-89f5-4c10-973d-d54f55c5df80 req-c81351aa-4eda-41d6-84b8-c0cf22891099 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 210 time: 0.0490229 May 26 14:48:04.178483 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-81556065-f887-4714-a400-6800a28d6772 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:04.183894 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81556065-f887-4714-a400-6800a28d6772 None None] The sync data for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi is: [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:48:04.398979 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e673b9c-afa3-4a3a-904f-6b7f4a59247b None None] New status for floating IP 79494d40-36bf-43b0-96dc-800598e41e2f: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:48:04.843375 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-074cc765-57ef-4b33-9337-7a333085e694 req-7b75d7b1-a75d-41e3-a411-91def06939e7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=c0b9a5b8-6c60-41c6-8785-d47a9ed0d257 HTTP/1.1" status: 200 len: 210 time: 0.0592203 May 26 14:48:04.878625 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-3b240ab7-14a9-4479-84d2-f9f4c839cbab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:04.880023 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-3b240ab7-14a9-4479-84d2-f9f4c839cbab service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=3defae92a9a1480c9278cae3445f9617&device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 1098 time: 0.1421099 May 26 14:48:05.012180 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-cd1a5b0e-38d0-4db2-bfc6-ab35bd6e71d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:05.013999 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-cd1a5b0e-38d0-4db2-bfc6-ab35bd6e71d8 service neutron] 10.222.0.79 "GET /v2.0/networks?id=f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 200 len: 917 time: 0.1270497 May 26 14:48:05.083366 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-bcc1d16e-ace4-4db6-b368-f3dcf1d07dcd service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 200 len: 217 time: 0.0614820 May 26 14:48:05.178089 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-956d6773-f31b-4d61-ad65-8e06b21de23a req-92dc13c6-1741-42e0-97bf-4f7cb4ffb6a9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 210 time: 0.0836580 May 26 14:48:05.196484 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-6b6169d9-49ca-4f46-ba59-fc307ae573cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:05.198164 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-6b6169d9-49ca-4f46-ba59-fc307ae573cd service neutron] 10.222.0.79 "GET /v2.0/subnets?id=466228a3-069c-4ecc-9790-37e83a8604c9 HTTP/1.1" status: 200 len: 854 time: 0.1060858 May 26 14:48:05.282026 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-8a437dde-79cb-4e2a-9f74-67dc41ec7c22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:05.283565 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-8a437dde-79cb-4e2a-9f74-67dc41ec7c22 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=f37261a9-5fa8-47e1-88e3-772578212058&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0793178 May 26 14:48:05.424170 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-ef337e01-609d-4e0d-bf46-bd6a2c524c6b service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277871 May 26 14:48:05.556521 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8d237da5-0ffe-42d8-b12a-0ed7f18771ad req-5120a305-140a-4694-a11a-015bc3233db2 service neutron] 10.222.0.79 "GET /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253037 May 26 14:48:05.687198 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 0ecd487f-30b4-4cc4-b331-76c06312e6b0 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:05.726762 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 0ecd487f-30b4-4cc4-b331-76c06312e6b0 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:05.727152 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 0ecd487f-30b4-4cc4-b331-76c06312e6b0 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:05.928716 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-1004ab93-afb9-4963-8904-6633cfea50c5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:05.930954 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-1004ab93-afb9-4963-8904-6633cfea50c5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 816 time: 0.1676552 May 26 14:48:05.986628 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45268) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:06.080651 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.115295 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.122411 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-3438f6bd-4e33-40db-8260-55e9592bd554 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f2b58b2245f643ac9193934fdab405c5 HTTP/1.1" status: 200 len: 379 time: 0.1778743 May 26 14:48:06.133957 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'port': {'device_id': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'admin_state_up': True, 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'security_groups': ['e8c42ca2-93cf-4598-951c-cdf06028ae80']}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:06.183993 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.188343 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-11af0395-0d98-49b7-911d-25cb3ff9985c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:06.221068 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=885c9e1a-12b0-4463-9740-2b7fe71b6599,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:06.246757 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.248666 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.249164 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.249663 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.250720 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.252621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.253135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.253635 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.254734 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.256893 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.257418 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.257927 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:06.263766 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.268557 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "DELETE /v2.0/security-groups/885c9e1a-12b0-4463-9740-2b7fe71b6599 HTTP/1.1" status: 204 len: 168 time: 0.2809162 May 26 14:48:06.269795 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:06.270545 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45284) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:06.303759 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:06.314183 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.api.v2.resource [None req-0db18d2e-238c-401d-aed6-b3fcf32095b2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] show failed (client error): The resource could not be found. May 26 14:48:06.318274 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0db18d2e-238c-401d-aed6-b3fcf32095b2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups/885c9e1a-12b0-4463-9740-2b7fe71b6599 HTTP/1.1" status: 404 len: 347 time: 0.0391366 May 26 14:48:06.318833 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45288) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:06.326088 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:06.375791 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Made reservation on behalf of f2b58b2245f643ac9193934fdab405c5 for: {'port': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:48:06.379699 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.400257 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6b6d8826-eff9-4d92-a394-7ea958e1c1cb req-fdf48aa0-310f-4c03-81ad-20ca489f6c8c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 210 time: 0.0678449 May 26 14:48:06.565629 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Allocated IP 172.20.0.6 (dcbc30ab-336e-46b8-a284-99efba24886a/74523655-70dc-48f8-8616-d6b84cac2d6d/210e790a-2172-4934-bf39-2d9aecd01a92) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:48:06.638889 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Deleting port 45899353-2a2b-4a22-b434-4c77a4814963 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:06.639224 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.758327 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.758675 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.758979 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.774421 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Transition to ACTIVE for port object 210e790a-2172-4934-bf39-2d9aecd01a92 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:48:06.797828 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.803329 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:06.872786 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Network dcbc30ab-336e-46b8-a284-99efba24886a is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:48:06.876868 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:48:06.880714 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:48:06.881324 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Calling delete_port for 45899353-2a2b-4a22-b434-4c77a4814963 owned by network:floatingip {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:06.913581 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:06.916812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:06.954122 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:06.954873 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:06.983351 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8530796 May 26 14:48:07.001649 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.005944 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-58200e9c-52fd-40af-8ffe-691c6703ccd1 tempest-DeleteServersTestJSON-2003850561 tempest-DeleteServersTestJSON-2003850561-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:07.053135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event deleted for resources: {'Port': ['ID=45899353-2a2b-4a22-b434-4c77a4814963,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:07.056327 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:07.113876 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-4cd7e067-48b7-4af7-89ba-f070c554dd7f None None] Provisioning for port 210e790a-2172-4934-bf39-2d9aecd01a92 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:48:07.119142 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-4cd7e067-48b7-4af7-89ba-f070c554dd7f None None] Provisioning complete for port 210e790a-2172-4934-bf39-2d9aecd01a92 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:48:07.119657 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-4cd7e067-48b7-4af7-89ba-f070c554dd7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.143196 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.163360 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.168280 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "DELETE /v2.0/floatingips/79494d40-36bf-43b0-96dc-800598e41e2f HTTP/1.1" status: 204 len: 168 time: 0.8483145 May 26 14:48:07.175116 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-4cd7e067-48b7-4af7-89ba-f070c554dd7f None None] Port 210e790a-2172-4934-bf39-2d9aecd01a92 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:48:07.603662 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e7935a8-7207-40c9-b695-733d591b17ed req-34d49598-6b87-4677-ad53-3733d044785f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:07.604433 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-2e7935a8-7207-40c9-b695-733d591b17ed req-34d49598-6b87-4677-ad53-3733d044785f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Synchronizing usage tracker for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:48:07.622635 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-2e7935a8-7207-40c9-b695-733d591b17ed req-34d49598-6b87-4677-ad53-3733d044785f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Unset dirty status for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:48:07.624529 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2e7935a8-7207-40c9-b695-733d591b17ed req-34d49598-6b87-4677-ad53-3733d044785f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 931 time: 0.1035211 May 26 14:48:07.625586 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45304) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:07.630697 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1202542401', 'description': 'tempest-description--1054223674'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:07.649366 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:07.657555 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:security_group and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:07.661904 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:07.674595 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:07.691552 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2e7935a8-7207-40c9-b695-733d591b17ed req-1e739576-9522-46f4-9aac-0a15a741283f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0563853 May 26 14:48:07.692775 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.712968 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:07.716990 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:security_group_rule and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:07.719875 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:07.725642 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:07.794542 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.800919 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.807068 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:07.848764 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f9197882-88a8-47ad-8b3b-7218a705f568,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:07.851544 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.852875 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.2261884 May 26 14:48:07.853697 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:07.855834 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45308) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:07.860854 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'security_group_rule': {'security_group_id': 'f9197882-88a8-47ad-8b3b-7218a705f568', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:07.866985 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:07.871107 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:security_group_rule and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:07.873961 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:07.880291 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:07.896966 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.962643 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.967971 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:07.973996 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a2fb9f0a-852c-4f65-ab41-a33758a7c217 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:07.992634 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb2bf3bd-ab42-4a85-9783-e9ee236785de,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:07.995033 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:08.005125 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.006422 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-8221a40b-d05c-4dbb-ae92-49df87d5b61f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1495755 May 26 14:48:08.009200 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45312) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:08.014505 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'security_group_rule': {'security_group_id': 'f9197882-88a8-47ad-8b3b-7218a705f568', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:08.020192 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:08.024103 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:security_group_rule and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:08.027188 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:08.033161 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:08.051999 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.116117 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.121942 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.123993 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:08.146047 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=71712870-9272-482d-90d5-392044dc7226,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:08.148378 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:08.156134 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.157358 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1471832 May 26 14:48:08.160473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45316) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:08.165765 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:08.171761 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:08.175655 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:floatingip and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:08.178579 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:08.184347 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:08.197446 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.338671 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.483059 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Allocated IP 172.27.3.156 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/17a8670a-1595-4038-bb0e-defaf12e2fb3) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:48:08.631890 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.664686 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:08.668262 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-26e7465c-7312-4d3f-a4fe-847b0d10f27a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:08.729457 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:48:08.732357 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:48:08.735818 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:48:08.768740 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'Port': ['ID=17a8670a-1595-4038-bb0e-defaf12e2fb3,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:08.774735 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:08.866928 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:09.033105 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:09.062751 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8636f1a7-34ff-46eb-818f-d6333db190d2 req-77f8ddff-9362-4e75-a6c3-b5d640af3045 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:09.064228 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8636f1a7-34ff-46eb-818f-d6333db190d2 req-77f8ddff-9362-4e75-a6c3-b5d640af3045 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 931 time: 0.2556460 May 26 14:48:09.139419 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8636f1a7-34ff-46eb-818f-d6333db190d2 req-3c17748d-3e49-43bb-9b5e-387b02ce8230 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0629854 May 26 14:48:09.284045 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:09.292332 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:09.298359 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:09.407851 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Request body: {'port': {'device_id': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:09.449903 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'Port': ['ID=17a8670a-1595-4038-bb0e-defaf12e2fb3,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:09.465048 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:09.477734 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:09.552580 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:09.553774 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-92f2a399-e0eb-4199-b55e-cb73676b4f5c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.3923724 May 26 14:48:09.554847 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:09.859768 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-b9d8cdda-9a8f-4a47-b0f5-22dc6f834b8c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Synchronizing usage tracker for tenant:c906c656a3474e64ab918724c042f2be on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:48:09.895643 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-b9d8cdda-9a8f-4a47-b0f5-22dc6f834b8c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Unset dirty status for tenant:c906c656a3474e64ab918724c042f2be on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:48:09.896824 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-b9d8cdda-9a8f-4a47-b0f5-22dc6f834b8c tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-securitygroup--1202542401&fields=id&tenant_id=c906c656a3474e64ab918724c042f2be HTTP/1.1" status: 200 len: 267 time: 0.1049688 May 26 14:48:10.050323 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 210e790a-2172-4934-bf39-2d9aecd01a92 {{(pid=98445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:48:10.062328 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:10.106992 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Transition to ACTIVE for port object 210e790a-2172-4934-bf39-2d9aecd01a92 will not be triggered until provisioned by entity L2. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:48:10.114112 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:10.123738 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5744b9cd-864f-499c-aa57-ac7d73474854 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:10.162586 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-4d975f5c-24dd-4a02-8d30-67712611d2ed tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:10.167935 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-4d975f5c-24dd-4a02-8d30-67712611d2ed tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 811 time: 0.2605414 May 26 14:48:10.267409 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-6c95280a-7c4c-437b-8284-da436cdfa0c9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/quotas/c906c656a3474e64ab918724c042f2be HTTP/1.1" status: 200 len: 375 time: 0.0875604 May 26 14:48:10.313422 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:10.340453 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:10.504550 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Attempting to bind port 210e790a-2172-4934-bf39-2d9aecd01a92 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:48:10.504905 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Attempting to bind port 210e790a-2172-4934-bf39-2d9aecd01a92 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:48:10.505183 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Attempting to bind port 210e790a-2172-4934-bf39-2d9aecd01a92 on network dcbc30ab-336e-46b8-a284-99efba24886a {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:48:10.512998 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Port 210e790a-2172-4934-bf39-2d9aecd01a92 on network dcbc30ab-336e-46b8-a284-99efba24886a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:48:10.513317 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Attempting to bind port 210e790a-2172-4934-bf39-2d9aecd01a92 on network dcbc30ab-336e-46b8-a284-99efba24886a {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:48:10.529627 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9f8e16-173a-4e60-8d67-6bc1f2979eda req-f0cc8a75-2a50-4150-8d51-e8eee1e7200b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:10.531128 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3a9f8e16-173a-4e60-8d67-6bc1f2979eda req-f0cc8a75-2a50-4150-8d51-e8eee1e7200b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.2658148 May 26 14:48:10.531881 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 47, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:48:10.532435 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Checking segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:48:10.532593 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Bound using segment: {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:48:10.533003 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Bound port: 210e790a-2172-4934-bf39-2d9aecd01a92, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '75b3edd7-3613-43c2-a8ac-684a11f6e11f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1101, 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a'}}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:48:10.533878 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:10.556226 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-caab5b4a-943b-4d39-ad0d-af4a42778df2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2535632 May 26 14:48:10.675919 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3a9f8e16-173a-4e60-8d67-6bc1f2979eda req-7c72df4d-d666-48f7-9742-71e97a116910 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1280689 May 26 14:48:10.860018 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, cleared binding levels {{(pid=98445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:48:10.878834 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:48:10.898467 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:10.904964 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1dce8866-0622-47a6-b691-4da124b27508 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:10.987242 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-c46173af-7f52-4ca0-bc3d-b8fd20b569bc service neutron] 10.222.0.72 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4121377 May 26 14:48:10.988437 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:10.989040 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:10.990325 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] 10.222.0.79 "PUT /v2.0/ports/210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 200 len: 1093 time: 1.5919945 May 26 14:48:10.993036 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:11.096094 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92', 'status': 'completed', 'code': 200} May 26 14:48:11.157208 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=3']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:11.172380 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:11.234827 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-0b2e518a-8309-449c-a373-3c030a975540 service neutron] 10.222.0.72 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2365258 May 26 14:48:11.241064 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-65688c2d-f12d-47d0-9c78-ae507fd6a3cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:11.242660 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-65688c2d-f12d-47d0-9c78-ae507fd6a3cf service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1096 time: 0.1495204 May 26 14:48:11.325918 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-25abb628-b83a-4ff7-9f23-5b7918aaff41 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 200 len: 217 time: 0.0691125 May 26 14:48:11.402748 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-7e7c7128-7913-42b0-b0b8-15112be41f5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:11.407941 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-7e7c7128-7913-42b0-b0b8-15112be41f5a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0673957 May 26 14:48:11.503719 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c51ea7e9-d797-4399-91ca-a7946c7490c4 req-2878ecc9-d9d1-4471-9461-2567d0fbea62 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.0482550 May 26 14:48:11.533832 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-810314b3-a207-41f1-bcce-f8f0e674384b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:11.535536 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-810314b3-a207-41f1-bcce-f8f0e674384b service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1189973 May 26 14:48:11.876048 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ea768e-ba53-4e78-bd79-314da4441262 req-6b4aa94e-64c7-4177-984b-48f07870b7ac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:11.877562 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c7ea768e-ba53-4e78-bd79-314da4441262 req-6b4aa94e-64c7-4177-984b-48f07870b7ac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0843027 May 26 14:48:11.922492 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c7ea768e-ba53-4e78-bd79-314da4441262 req-35cf6887-831e-4d7d-b657-a9bad199d759 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389597 May 26 14:48:12.602126 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-0b451773-6229-4a95-96f8-3bf2030e2ffd service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1426508 May 26 14:48:12.654325 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8cced46a-2885-47ed-90c5-19fb099747ae req-a57d94bc-7b07-4d5e-ad22-cff9e0816b44 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.0403950 May 26 14:48:13.164813 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09730322-f247-4db5-91ce-15ef7c8699d4 req-2e65d24a-959f-4bbd-9746-d7235821d711 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:13.165858 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-09730322-f247-4db5-91ce-15ef7c8699d4 req-2e65d24a-959f-4bbd-9746-d7235821d711 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1069903 May 26 14:48:13.223393 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-09730322-f247-4db5-91ce-15ef7c8699d4 req-42aafa01-b10b-44f6-86ca-eec606d883f5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489154 May 26 14:48:13.822897 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-89ad9edc-e34c-4b6b-9000-d004545e212a req-cd364cc9-bff2-4f7c-b335-328b7b1bf985 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.0422628 May 26 14:48:14.484575 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dbfb4c66-56ea-4f8d-b5fb-af60217f35a7 req-fdea6d33-d130-4029-afe4-bc132b3f3635 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1952167 May 26 14:48:14.503394 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b892bbf7-a6e2-44b0-bda7-26f639384ac0 req-c93abdf5-5e23-4a85-bb33-6d1784a9331c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:14.504877 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b892bbf7-a6e2-44b0-bda7-26f639384ac0 req-c93abdf5-5e23-4a85-bb33-6d1784a9331c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1303654 May 26 14:48:14.551594 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b892bbf7-a6e2-44b0-bda7-26f639384ac0 req-8bf8a8ee-3bb7-464f-9e6c-0c94049df5a1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406568 May 26 14:48:14.663761 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-3e785873-5cea-4d1d-a545-e647cd8a1923 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:14.665279 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-3e785873-5cea-4d1d-a545-e647cd8a1923 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1096 time: 0.0722120 May 26 14:48:14.810634 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-8b88629e-75f8-4cff-b3f8-f5ac656973d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:14.812074 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-8b88629e-75f8-4cff-b3f8-f5ac656973d3 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1303005 May 26 14:48:14.970728 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-27561b33-dbf5-4463-a027-ff0815261a21 req-cf7bd2ac-af3a-4cd3-98f1-d6db81677ab5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.0412862 May 26 14:48:15.836899 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-e8fe4c41-c494-4c2f-ab23-1362edd00488 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 200 len: 217 time: 0.1972268 May 26 14:48:15.888953 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1fa6fb-45ce-47e3-b8a4-46480af78d4a req-3125ed0c-dc41-4147-81a1-e4fccea79120 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:15.891083 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dd1fa6fb-45ce-47e3-b8a4-46480af78d4a req-3125ed0c-dc41-4147-81a1-e4fccea79120 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0969582 May 26 14:48:15.939084 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dd1fa6fb-45ce-47e3-b8a4-46480af78d4a req-c783de57-863f-446b-b273-d97722e5d13d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420346 May 26 14:48:16.127826 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26d1b953-1f4e-4cbf-820c-5af7bb6d3217 req-da56628c-c216-49e7-9f81-aa2ecf0ef78b tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.0463152 May 26 14:48:16.555324 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-ca5a8d72-9733-46ad-bf4e-f3b055099fcf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:16.556871 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-ca5a8d72-9733-46ad-bf4e-f3b055099fcf service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0730062 May 26 14:48:17.162209 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5789889e-fc08-424f-b7a9-c94968a086cc req-b5cdec1d-0fe8-4587-92c0-c08e27a91298 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:17.169460 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5789889e-fc08-424f-b7a9-c94968a086cc req-b5cdec1d-0fe8-4587-92c0-c08e27a91298 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1056142 May 26 14:48:17.210629 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5789889e-fc08-424f-b7a9-c94968a086cc req-51feef28-e440-44e9-8ea6-ebc2919d97b6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403028 May 26 14:48:17.281517 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-195db645-af5e-4813-88d7-4a34f9f95f46 req-99b8e0fe-e165-485e-a75d-295bf8d3b5e3 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.0454555 May 26 14:48:17.519278 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-2d7c7359-71d7-40ba-b8c8-d06339a14a2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:17.521266 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-2d7c7359-71d7-40ba-b8c8-d06339a14a2a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0876670 May 26 14:48:17.698895 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-afd23c98-ef02-4443-9649-8aa6de59f64d service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1639841 May 26 14:48:17.850935 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5d4a1ff-56f1-4fe5-8927-7bfdd1b3ed3b req-62c765ea-72b7-4d08-aced-d2368577d1de service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1434817 May 26 14:48:17.864553 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-4d2c3d75-7685-46c4-bf4e-b389557e9d9b tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:17.866023 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-4d2c3d75-7685-46c4-bf4e-b389557e9d9b tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 811 time: 0.1973999 May 26 14:48:17.945094 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-95258687-f0e7-432a-a150-7a089aef970e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Synchronizing usage tracker for tenant:c906c656a3474e64ab918724c042f2be on resource:security_group {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:48:17.957395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-95258687-f0e7-432a-a150-7a089aef970e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Unset dirty status for tenant:c906c656a3474e64ab918724c042f2be on resource:security_group {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:48:17.958548 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-95258687-f0e7-432a-a150-7a089aef970e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c906c656a3474e64ab918724c042f2be HTTP/1.1" status: 200 len: 380 time: 0.0582769 May 26 14:48:18.430389 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-77b0b38e-d777-4e72-be14-3b00f93c42c3 req-c6ffa1e9-f79b-4494-9f1c-14d09a83fbac tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.0437698 May 26 14:48:18.448346 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04665fd8-af4a-44f7-b4c2-eaaafd2228d2 req-ab14e54f-da78-49ac-b470-375466e11a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:18.449825 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-04665fd8-af4a-44f7-b4c2-eaaafd2228d2 req-ab14e54f-da78-49ac-b470-375466e11a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1276119 May 26 14:48:18.499239 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-04665fd8-af4a-44f7-b4c2-eaaafd2228d2 req-0ec48e93-9c08-4266-8f01-dc86d4d88f16 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416708 May 26 14:48:19.591952 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d32f8210-1619-4256-977f-620b32d06957 req-32439ebc-6fc2-4b75-898d-dc9e0d0644a8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.0451345 May 26 14:48:19.696154 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae6eccc-26d2-4cd6-bf54-d4639b65e35d req-1d2b6aa4-d616-446e-b1e2-f0db1e4bc3a8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:19.697609 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cae6eccc-26d2-4cd6-bf54-d4639b65e35d req-1d2b6aa4-d616-446e-b1e2-f0db1e4bc3a8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0858381 May 26 14:48:19.728971 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'port': {'device_id': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'admin_state_up': True, 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'security_groups': ['f9197882-88a8-47ad-8b3b-7218a705f568']}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:19.746915 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cae6eccc-26d2-4cd6-bf54-d4639b65e35d req-fc8a6494-4e9b-4700-86a0-ea58963f4168 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405970 May 26 14:48:19.873215 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:19.877608 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Usage tracker for resource:port and tenant:c906c656a3474e64ab918724c042f2be is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:19.880677 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Quota usage for port was recalculated. Used quota:3. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:19.886528 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:19.898099 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Made reservation on behalf of c906c656a3474e64ab918724c042f2be for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:48:19.906901 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:20.064985 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Allocated IP 172.20.0.14 (82f940d8-9b5b-4a1a-9b79-05f05dbfa116/0ff14072-b6ed-4e7e-acdf-9c02d2a054b3/cd553d24-bf3e-45c7-903e-b5459cf05099) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:48:20.261658 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:20.277625 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Transition to ACTIVE for port object cd553d24-bf3e-45c7-903e-b5459cf05099 will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:48:20.310349 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:20.316042 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9f7c0ef8-da1c-4597-8eb3-5f72e64bafa1 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:20.381378 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:48:20.384544 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:48:20.388278 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:48:20.418845 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event updated for resources: {'Port': ['ID=cd553d24-bf3e-45c7-903e-b5459cf05099,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:20.425563 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:20.459765 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:20.460394 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:20.488600 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7636125 May 26 14:48:20.627459 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-7dfbe533-a836-489e-b5dc-18f649744930 None None] Provisioning for port cd553d24-bf3e-45c7-903e-b5459cf05099 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:48:20.632806 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-7dfbe533-a836-489e-b5dc-18f649744930 None None] Provisioning complete for port cd553d24-bf3e-45c7-903e-b5459cf05099 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:48:20.633188 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7dfbe533-a836-489e-b5dc-18f649744930 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:20.687764 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-7dfbe533-a836-489e-b5dc-18f649744930 None None] Port cd553d24-bf3e-45c7-903e-b5459cf05099 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:48:20.736241 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Request body: {'port': {'device_id': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:20.789892 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae3034e6-5757-4369-90f3-98a751ef12c0 req-bcd0386b-2f3c-4198-975f-dcbd32d90855 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:20.791438 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ae3034e6-5757-4369-90f3-98a751ef12c0 req-bcd0386b-2f3c-4198-975f-dcbd32d90855 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 932 time: 0.0896914 May 26 14:48:20.847431 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ae3034e6-5757-4369-90f3-98a751ef12c0 req-faff2f28-f9b9-4f8b-badc-71bbd6e939b2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499778 May 26 14:48:20.849630 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:20.943353 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16507d4-ee4f-4db4-8505-53ee3fe9936e req-407935f1-ea33-4537-8458-4372f72f46eb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:20.945452 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c16507d4-ee4f-4db4-8505-53ee3fe9936e req-407935f1-ea33-4537-8458-4372f72f46eb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0813622 May 26 14:48:20.994260 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c16507d4-ee4f-4db4-8505-53ee3fe9936e req-7185437d-9825-4224-9acb-6237c78857fd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434337 May 26 14:48:21.204651 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cd553d24-bf3e-45c7-903e-b5459cf05099 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:48:21.212544 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:21.227420 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Transition to ACTIVE for port object cd553d24-bf3e-45c7-903e-b5459cf05099 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:48:21.232475 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:21.237136 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:21.447905 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:48:21.476966 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Pushing event updated for resources: {'Port': ['ID=cd553d24-bf3e-45c7-903e-b5459cf05099,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:21.480249 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:21.555945 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Attempting to bind port cd553d24-bf3e-45c7-903e-b5459cf05099 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:48:21.556268 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Attempting to bind port cd553d24-bf3e-45c7-903e-b5459cf05099 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:48:21.556608 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Attempting to bind port cd553d24-bf3e-45c7-903e-b5459cf05099 on network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:48:21.561228 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Port cd553d24-bf3e-45c7-903e-b5459cf05099 on network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:48:21.561579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Attempting to bind port cd553d24-bf3e-45c7-903e-b5459cf05099 on network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:48:21.566800 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 47, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:48:21.567127 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Checking segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:48:21.567499 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Bound using segment: {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:48:21.567921 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Bound port: cd553d24-bf3e-45c7-903e-b5459cf05099, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '567291f9-aa99-493c-b4d7-e95dc1f1b3f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1134, 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:48:21.568260 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:21.595959 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:21.612504 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '210e790a-2172-4934-bf39-2d9aecd01a92', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'port_id': '210e790a-2172-4934-bf39-2d9aecd01a92', 'mac_address': 'fa:16:3e:3b:ad:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:48:21.660306 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] For port cd553d24-bf3e-45c7-903e-b5459cf05099, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:48:21.663854 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] For port cd553d24-bf3e-45c7-903e-b5459cf05099, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=cd553d24-bf3e-45c7-903e-b5459cf05099,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:48:21.668745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:21.672850 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e993d09e-77d5-4243-8822-cc8d444f4dd2 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:21.718921 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b9345839-8324-4a0d-8806-206836a37696 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:21.723475 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:21.734197 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:21.734832 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:21.736184 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] 10.222.0.79 "PUT /v2.0/ports/cd553d24-bf3e-45c7-903e-b5459cf05099 HTTP/1.1" status: 200 len: 1094 time: 1.0045443 May 26 14:48:21.736710 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'tag': 'cd553d24-bf3e-45c7-903e-b5459cf05099'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:21.740972 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 210e790a-2172-4934-bf39-2d9aecd01a92 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:48:21.756069 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Pushing event updated for resources: {'Port': ['ID=cd553d24-bf3e-45c7-903e-b5459cf05099,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:21.757422 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:21.759922 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:21.764008 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:21.765946 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:21.836306 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:21.840032 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:21.866558 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'tag': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'status': 'completed', 'code': 200} May 26 14:48:21.886249 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-1b559a61-cf1f-4b92-bf5b-56d2dcb5a7ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:21.887859 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-1b559a61-cf1f-4b92-bf5b-56d2dcb5a7ad service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 1097 time: 0.0842621 May 26 14:48:21.980228 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-c0325216-fac2-48e9-98af-01bad8752420 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cd553d24-bf3e-45c7-903e-b5459cf05099 HTTP/1.1" status: 200 len: 217 time: 0.0745451 May 26 14:48:22.063030 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff84ff2-3bdc-4c2b-a913-5149f0fa2777 req-8c12e6a4-4507-4c4d-a6fd-d80191cab3a9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:22.063565 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2ff84ff2-3bdc-4c2b-a913-5149f0fa2777 req-8c12e6a4-4507-4c4d-a6fd-d80191cab3a9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 944 time: 0.1068799 May 26 14:48:22.067293 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-03cfac81-96c4-4d07-87b3-359cdb1e473f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:22.069073 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-03cfac81-96c4-4d07-87b3-359cdb1e473f service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.0812652 May 26 14:48:22.111689 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2ff84ff2-3bdc-4c2b-a913-5149f0fa2777 req-653b11fb-69b0-4ace-afae-08d60d0ffcff tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406377 May 26 14:48:22.123452 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['210e790a-2172-4934-bf39-2d9aecd01a92'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:48:22.201937 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-d71e184d-f361-472f-afa6-860283725ddc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:22.203946 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-d71e184d-f361-472f-afa6-860283725ddc service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1236753 May 26 14:48:22.280347 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd5a8979-a20f-47b0-a15c-6938daa838cc req-35bba216-2eea-4b76-8ae3-b70494c17ee2 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:22.286194 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dd5a8979-a20f-47b0-a15c-6938daa838cc req-35bba216-2eea-4b76-8ae3-b70494c17ee2 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 944 time: 0.1330602 May 26 14:48:22.375099 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-dd5a8979-a20f-47b0-a15c-6938daa838cc req-6b776148-ad68-4b3a-8e47-87ad7df01105 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0821009 May 26 14:48:22.380761 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-92fc48e0-be8d-47c7-b712-d0b47923bcd5 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1682253 May 26 14:48:22.531336 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-0d55e39e-2f7b-4183-bebc-5db2d77e3f2d req-a5d06404-bc28-45d1-9a0c-45aa6e023a51 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1427767 May 26 14:48:22.632824 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d5c688-4d1d-47ff-bbae-2671e09ced01 req-01a6ed18-b27e-4f61-8965-dbe625d41d69 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:22.634284 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30d5c688-4d1d-47ff-bbae-2671e09ced01 req-01a6ed18-b27e-4f61-8965-dbe625d41d69 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0821075 May 26 14:48:22.681227 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30d5c688-4d1d-47ff-bbae-2671e09ced01 req-cbcbd020-d5d6-4525-945a-9f1c916ae2dd tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396605 May 26 14:48:22.738327 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-7029d694-4911-4fd4-a225-5fb3fb9df59d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:22.739969 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-7029d694-4911-4fd4-a225-5fb3fb9df59d service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 1097 time: 0.0768452 May 26 14:48:22.882082 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-ebe86b86-2037-441c-b8a5-46be225b8b63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:22.883743 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-ebe86b86-2037-441c-b8a5-46be225b8b63 service neutron] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 913 time: 0.1365366 May 26 14:48:22.955818 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-57650f11-ddc9-4127-bf0e-e175712cbec9 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cd553d24-bf3e-45c7-903e-b5459cf05099 HTTP/1.1" status: 200 len: 217 time: 0.0636103 May 26 14:48:23.024462 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-7aeb9fd6-2f8c-4097-8326-e0765df29b00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:23.025906 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-7aeb9fd6-2f8c-4097-8326-e0765df29b00 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.0618877 May 26 14:48:23.100849 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-df1001fc-0a7f-45f7-a302-f65b9847b406 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:23.102295 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-df1001fc-0a7f-45f7-a302-f65b9847b406 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0697196 May 26 14:48:23.264177 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f5aa8d6e-44ad-47cc-a050-4648c78db0f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:23.305167 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-948f4c2c-d48a-4ff7-8a01-f06b0e1d1d33 req-af416e42-faf8-454c-9fd2-1cc09699fc21 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:23.306560 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-948f4c2c-d48a-4ff7-8a01-f06b0e1d1d33 req-af416e42-faf8-454c-9fd2-1cc09699fc21 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 944 time: 0.0849550 May 26 14:48:23.443975 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-948f4c2c-d48a-4ff7-8a01-f06b0e1d1d33 req-6fed199c-30ec-486e-922a-d66d61956b76 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1314421 May 26 14:48:23.573926 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45355ada-a8d0-4cb2-b511-78a3ebc219cd req-6b103ef6-5ea9-4e9a-bfbf-3bda3d6fb9df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:23.575387 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-45355ada-a8d0-4cb2-b511-78a3ebc219cd req-6b103ef6-5ea9-4e9a-bfbf-3bda3d6fb9df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 944 time: 0.0832636 May 26 14:48:23.623387 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-45355ada-a8d0-4cb2-b511-78a3ebc219cd req-80e9a45d-55a1-48ff-b101-0727c25b6ced tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418565 May 26 14:48:23.873933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b75d63-af23-4b31-ac8a-e15f85bc8524 req-d74f4ef7-c52a-4b55-858f-b3bb4bdf7f10 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:23.875336 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b3b75d63-af23-4b31-ac8a-e15f85bc8524 req-d74f4ef7-c52a-4b55-858f-b3bb4bdf7f10 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0793047 May 26 14:48:23.922542 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b3b75d63-af23-4b31-ac8a-e15f85bc8524 req-adadb7d3-ba57-48b0-abb7-fd5e72bb6687 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385091 May 26 14:48:24.122164 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-148b2f5d-f2e3-40b4-a7da-229cec9d5940 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1391585 May 26 14:48:24.561411 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:24.642352 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b342667-52be-4432-ab88-29b81cd7f042 req-76a2d71f-72df-4aad-af07-75d1954922f4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:24.643919 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6b342667-52be-4432-ab88-29b81cd7f042 req-76a2d71f-72df-4aad-af07-75d1954922f4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 944 time: 0.0863595 May 26 14:48:24.689110 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6b342667-52be-4432-ab88-29b81cd7f042 req-ff8e57b7-bba9-4167-bcdb-240d91e7b69a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393393 May 26 14:48:24.830202 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbabfe81-1e2a-4cd6-b418-8176a55cf9eb req-8f978dbc-f76f-4a69-92e0-b6577c4309c1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:24.831709 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bbabfe81-1e2a-4cd6-b418-8176a55cf9eb req-8f978dbc-f76f-4a69-92e0-b6577c4309c1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 944 time: 0.0859747 May 26 14:48:24.876939 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bbabfe81-1e2a-4cd6-b418-8176a55cf9eb req-615100c0-0a13-46bc-abdf-0cd9248008cb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394499 May 26 14:48:25.120867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37ed94d-8274-4366-a12b-1b21efe68513 req-7d87bfa0-ca9e-4e8d-99ac-7b948ccb5cf1 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:25.122213 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a37ed94d-8274-4366-a12b-1b21efe68513 req-7d87bfa0-ca9e-4e8d-99ac-7b948ccb5cf1 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0838072 May 26 14:48:25.167111 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a37ed94d-8274-4366-a12b-1b21efe68513 req-cd284b33-e1ff-454c-bc84-7df7534cffcb tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390401 May 26 14:48:25.827178 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:48:25.903533 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:25.915502 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:25.918829 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ec80f8-8340-475a-854a-16cd86644e59 req-e677cb66-921b-4e5b-9fd7-79801402fe90 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:25.920687 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f0ec80f8-8340-475a-854a-16cd86644e59 req-e677cb66-921b-4e5b-9fd7-79801402fe90 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 944 time: 0.1116252 May 26 14:48:25.938643 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 210e790a-2172-4934-bf39-2d9aecd01a92 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:48:25.945852 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 210e790a-2172-4934-bf39-2d9aecd01a92 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:48:25.946743 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:25.980336 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f0ec80f8-8340-475a-854a-16cd86644e59 req-77a6125d-bfd3-41b2-8d3a-494778bd4bb8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533440 May 26 14:48:26.071873 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:26.072148 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d43b6ca7-7963-465c-8fdb-e3e0f45eaced req-25d7cd73-9c77-4da3-8f66-ed13fadd64fc service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2587280 May 26 14:48:26.100202 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:26.103943 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6ad47c6-4fa4-48ab-8aa6-d9d65dde6b34 req-f078b99c-ff69-455a-8978-d97c0ef84f45 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:26.106885 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b6ad47c6-4fa4-48ab-8aa6-d9d65dde6b34 req-f078b99c-ff69-455a-8978-d97c0ef84f45 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 944 time: 0.0882411 May 26 14:48:26.111772 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:26.116803 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:26.120259 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:26.154995 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b6ad47c6-4fa4-48ab-8aa6-d9d65dde6b34 req-1c7742ad-cdd9-4bb6-be87-1de3b9c52003 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427155 May 26 14:48:26.193997 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:26.198519 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:26.214022 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92', 'code': 200} May 26 14:48:26.354422 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ea91ea-6ca1-4f90-ad21-4a9e00efa381 req-b519416a-042f-4c27-9346-267915b7557f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:26.355788 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e3ea91ea-6ca1-4f90-ad21-4a9e00efa381 req-b519416a-042f-4c27-9346-267915b7557f tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0808291 May 26 14:48:26.406055 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e3ea91ea-6ca1-4f90-ad21-4a9e00efa381 req-2f1f6048-77ea-43ca-a5af-d0b52a0651ae tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439701 May 26 14:48:26.504704 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1ffcc6-b210-450d-9e39-340dd51e361c req-52ee3597-5eb3-4660-aa86-9a781e9cd50d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:26.506168 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-fb1ffcc6-b210-450d-9e39-340dd51e361c req-52ee3597-5eb3-4660-aa86-9a781e9cd50d service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1098 time: 0.0698709 May 26 14:48:26.549859 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-fb1ffcc6-b210-450d-9e39-340dd51e361c req-5fef1926-0469-413d-877b-510ae9996b3c service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0360060 May 26 14:48:27.162521 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-995f49aa-9ef6-4ab1-8668-12a05f15bddc req-8965b730-adbf-4546-a566-3b74e481fc2b tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:27.164732 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-995f49aa-9ef6-4ab1-8668-12a05f15bddc req-8965b730-adbf-4546-a566-3b74e481fc2b tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 944 time: 0.0825377 May 26 14:48:27.215635 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-995f49aa-9ef6-4ab1-8668-12a05f15bddc req-0e6755d2-9c71-490c-85ee-85caadb5e851 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441997 May 26 14:48:27.346228 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f93f60b-7b67-48e0-b0b0-0e70e30cd51c req-35edfe85-4a52-49e0-9535-16211d76e445 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:27.347807 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6f93f60b-7b67-48e0-b0b0-0e70e30cd51c req-35edfe85-4a52-49e0-9535-16211d76e445 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0852263 May 26 14:48:27.395402 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6f93f60b-7b67-48e0-b0b0-0e70e30cd51c req-6a60d9ad-09a5-44fa-b170-c6f4cb0699ef tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392804 May 26 14:48:27.475419 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:27.602600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd47c4b-0f76-45fc-9d1c-15f9fe34fa18 req-f81d4ebd-98ae-4d5a-9e96-849e42fe523b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:27.604149 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-efd47c4b-0f76-45fc-9d1c-15f9fe34fa18 req-f81d4ebd-98ae-4d5a-9e96-849e42fe523b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.0842516 May 26 14:48:27.647711 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-efd47c4b-0f76-45fc-9d1c-15f9fe34fa18 req-95a75035-f900-49c6-a30d-cba317f1ef7c tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/security-groups?id=11048e68-75a2-4529-93aa-c6555fbd1fe1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379403 May 26 14:48:27.803670 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-b15bd91a-2397-4f7b-adbd-00727204380a tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:27.804376 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-b15bd91a-2397-4f7b-adbd-00727204380a tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Synchronizing usage tracker for tenant:3defae92a9a1480c9278cae3445f9617 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:48:27.823794 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-b15bd91a-2397-4f7b-adbd-00727204380a tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Unset dirty status for tenant:3defae92a9a1480c9278cae3445f9617 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:48:27.824921 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-b15bd91a-2397-4f7b-adbd-00727204380a tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.79 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 945 time: 0.1141436 May 26 14:48:27.964088 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Deleting port ac07176b-6df8-402b-be15-ef2328d925a9 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:27.964410 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:28.106203 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] For port ac07176b-6df8-402b-be15-ef2328d925a9, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=ac07176b-6df8-402b-be15-ef2328d925a9,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:28.106515 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:28.234770 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Calling delete_port for ac07176b-6df8-402b-be15-ef2328d925a9 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:28.353347 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:28.359032 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a5bd074a-aa0d-496d-9594-e7e1e3ad8f4c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:28.390066 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['ac07176b-6df8-402b-be15-ef2328d925a9'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:48:28.410948 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Pushing event deleted for resources: {'Port': ['ID=ac07176b-6df8-402b-be15-ef2328d925a9,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:28.415598 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:28.432613 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75642b6e-6721-4f5c-9ecf-3ebc7d446a74 req-75f66915-967e-4eb6-8db5-ea00cb475361 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:28.434183 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-75642b6e-6721-4f5c-9ecf-3ebc7d446a74 req-75f66915-967e-4eb6-8db5-ea00cb475361 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 944 time: 0.1055167 May 26 14:48:28.484089 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-75642b6e-6721-4f5c-9ecf-3ebc7d446a74 req-94a796cb-c8be-4d5a-9482-dabd3e856f5a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424418 May 26 14:48:28.494138 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] No DVR routers for this DVR port ac07176b-6df8-402b-be15-ef2328d925a9 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:48:28.496848 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:28.507253 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'name': 'network-vif-deleted', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:28.519722 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-bb600326-18ae-461a-b3b3-ca8377a22cc8 req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.79 "DELETE /v2.0/ports/ac07176b-6df8-402b-be15-ef2328d925a9 HTTP/1.1" status: 204 len: 173 time: 0.6862068 May 26 14:48:28.559414 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07acf01f-ab70-4582-8e28-030c48fae6ee', 'name': 'network-vif-deleted', 'tag': 'ac07176b-6df8-402b-be15-ef2328d925a9', 'status': 'completed', 'code': 200} May 26 14:48:28.629341 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750fd433-290f-4400-b067-2607ff4a3a47 req-f541f038-8b78-44ab-be41-dbbb91d02839 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:28.630951 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-750fd433-290f-4400-b067-2607ff4a3a47 req-f541f038-8b78-44ab-be41-dbbb91d02839 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0894017 May 26 14:48:28.708553 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-750fd433-290f-4400-b067-2607ff4a3a47 req-13863e09-51b4-41f7-aa99-dfa3ac2a764a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0708940 May 26 14:48:28.887093 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8bfb1ffa-aa07-40f9-956e-e28c739788fc req-488cf258-2c7d-4865-bf87-1c583dec1dbb tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 210 time: 0.0453384 May 26 14:48:29.062633 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4baf7e66-3cd8-4d66-b677-6b3b08a49d80 req-a407d71b-2252-481e-9ec5-67b9baebb5b0 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:29.064150 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4baf7e66-3cd8-4d66-b677-6b3b08a49d80 req-a407d71b-2252-481e-9ec5-67b9baebb5b0 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0849278 May 26 14:48:29.074093 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45622) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:29.079747 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Request body: {'floatingip': {'port_id': '210e790a-2172-4934-bf39-2d9aecd01a92'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:29.159464 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:29.779512 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3313e8b0-f87e-4b15-aab4-335d71909a57 req-13077771-2ae3-4060-9c0f-d74502262a16 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:29.780883 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3313e8b0-f87e-4b15-aab4-335d71909a57 req-13077771-2ae3-4060-9c0f-d74502262a16 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 944 time: 0.1820858 May 26 14:48:29.839798 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3313e8b0-f87e-4b15-aab4-335d71909a57 req-b29d0f3c-aa8d-4e46-9106-114939060d9e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525827 May 26 14:48:29.940544 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:29.945671 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:30.063803 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-db77110c-0ae1-4044-9fbf-70cc0239a56f req-179fb8ee-6b7c-4fa7-a7cc-095bddd83858 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 210 time: 0.0522764 May 26 14:48:30.155800 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.l3_db [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Floating IP 2c320a0e-8f33-402c-bc7e-31008c534016 associated. External IP: 172.27.3.219, port: 210e790a-2172-4934-bf39-2d9aecd01a92. May 26 14:48:30.504992 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Router f62ef884-b65a-487d-8955-15d95245398f has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:48:30.794572 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:48:30.799039 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:30.804891 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] Sync routers for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:48:30.814711 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:30.815426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:48:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:30.852863 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-ec721b4a-3243-4c52-89f1-60cdc90e1fac tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "PUT /v2.0/floatingips/2c320a0e-8f33-402c-bc7e-31008c534016 HTTP/1.1" status: 200 len: 991 time: 1.7775877 May 26 14:48:30.853835 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:30.999427 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device cd553d24-bf3e-45c7-903e-b5459cf05099 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:48:31.008812 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:31.111496 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92', 'status': 'completed', 'code': 200} May 26 14:48:31.270385 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa8e580-45f5-443c-8ca4-60ba63dcb502 req-81cc67a8-e564-4a3d-96f3-aca91f65f9b0 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:31.271860 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ffa8e580-45f5-443c-8ca4-60ba63dcb502 req-81cc67a8-e564-4a3d-96f3-aca91f65f9b0 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 944 time: 0.0813527 May 26 14:48:31.318733 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ffa8e580-45f5-443c-8ca4-60ba63dcb502 req-0245d178-49c5-453e-80b5-8825e417288d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404670 May 26 14:48:31.360915 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port cd553d24-bf3e-45c7-903e-b5459cf05099, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=cd553d24-bf3e-45c7-903e-b5459cf05099,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:31.379958 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'port_id': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'mac_address': 'fa:16:3e:74:10:04', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1134, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:48:31.466994 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f8e8a900-3fc7-47f5-b0b0-0b5034c02564 req-cf9b278e-7936-461a-aa25-25faf2103013 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] 10.222.0.72 "GET /v2.0/ports?device_id=07acf01f-ab70-4582-8e28-030c48fae6ee HTTP/1.1" status: 200 len: 210 time: 0.0420141 May 26 14:48:31.494471 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:31.513189 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cd553d24-bf3e-45c7-903e-b5459cf05099 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:48:31.536783 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port cd553d24-bf3e-45c7-903e-b5459cf05099, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=cd553d24-bf3e-45c7-903e-b5459cf05099,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:31.543303 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:31.545765 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:31.607687 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '2c320a0e-8f33-402c-bc7e-31008c534016', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'floating_ip_address': '172.27.3.219', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'port_id': '210e790a-2172-4934-bf39-2d9aecd01a92', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 460, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'mac_address': 'fa:16:3e:3b:ad:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:47:59Z', 'updated_at': '2021-05-26T14:48:29Z', 'revision_number': 1, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:31.616637 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] Checking router: f62ef884-b65a-487d-8955-15d95245398f for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:48:31.626612 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=cd553d24-bf3e-45c7-903e-b5459cf05099,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:31.630241 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:31.631833 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:31.632425 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:48:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:31.841567 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:32.200023 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '2c320a0e-8f33-402c-bc7e-31008c534016', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'floating_ip_address': '172.27.3.219', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'port_id': '210e790a-2172-4934-bf39-2d9aecd01a92', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 460, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'mac_address': 'fa:16:3e:3b:ad:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:47:59Z', 'updated_at': '2021-05-26T14:48:29Z', 'revision_number': 1, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:32.214574 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04b3491b-82d6-4dff-b3dc-16c6d87c742e None None] The sync data for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi is: [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '2c320a0e-8f33-402c-bc7e-31008c534016', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'floating_ip_address': '172.27.3.219', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'port_id': '210e790a-2172-4934-bf39-2d9aecd01a92', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 460, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'mac_address': 'fa:16:3e:3b:ad:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:47:59Z', 'updated_at': '2021-05-26T14:48:29Z', 'revision_number': 1, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:48:32.235073 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:48:32.242860 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-3ce34e28-e087-4f44-b9ce-78fec086a6cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:32.244361 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-3ce34e28-e087-4f44-b9ce-78fec086a6cf service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1098 time: 0.0837598 May 26 14:48:32.439178 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-2359a84e-4d02-4ebe-a1d7-6433f086f5c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:32.440631 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-2359a84e-4d02-4ebe-a1d7-6433f086f5c4 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1893742 May 26 14:48:32.465575 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-165376b0-1236-4044-9254-bb6deb624b65 None None] New status for floating IP 2c320a0e-8f33-402c-bc7e-31008c534016: ACTIVE {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:48:32.497556 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['cd553d24-bf3e-45c7-903e-b5459cf05099'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:48:32.578882 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d59703fc-54c9-499c-b8ae-6031518bfff1 req-cfea28ae-2b73-45a7-bd3e-5504906d8da2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:32.581700 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d59703fc-54c9-499c-b8ae-6031518bfff1 req-cfea28ae-2b73-45a7-bd3e-5504906d8da2 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 945 time: 0.1238320 May 26 14:48:32.587693 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-9662adb1-5755-4135-ad1f-f4a6a8705621 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 200 len: 999 time: 0.1393259 May 26 14:48:32.664300 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-7fe19a34-ba8e-4e14-98de-f08bf7a16f62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:32.666173 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-7fe19a34-ba8e-4e14-98de-f08bf7a16f62 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0707388 May 26 14:48:32.669333 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d59703fc-54c9-499c-b8ae-6031518bfff1 req-3b270ade-b1c1-4229-8207-f7b5c1b5f43f tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0802195 May 26 14:48:32.762199 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-a2c7b24e-3145-4bd9-85aa-7e6e1b1fed27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:32.764871 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-a2c7b24e-3145-4bd9-85aa-7e6e1b1fed27 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0917175 May 26 14:48:32.929544 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-811151a7-bbf1-46bf-9f94-2c45840091d3 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1562591 May 26 14:48:33.207187 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5e4bf2ba-b6dc-4bec-a5d4-fd110ad94155 req-def811d9-7d34-4ac7-9033-7285534967f5 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2693579 May 26 14:48:33.450367 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45714) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:34.034954 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf06cd96-a34a-434c-8466-085b010e186c req-ed5c3a6f-116c-4afa-ba21-d58b6cfbc44e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:34.036396 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cf06cd96-a34a-434c-8466-085b010e186c req-ed5c3a6f-116c-4afa-ba21-d58b6cfbc44e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 945 time: 0.2486451 May 26 14:48:34.064473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62818d44-5b7f-468d-b22f-bc2e4f2932ca req-c962a327-c6bb-4dfd-90b2-8c581258855c tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:34.065898 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-62818d44-5b7f-468d-b22f-bc2e4f2932ca req-c962a327-c6bb-4dfd-90b2-8c581258855c tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 945 time: 0.2376847 May 26 14:48:34.092502 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device cd553d24-bf3e-45c7-903e-b5459cf05099 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:48:34.136595 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cf06cd96-a34a-434c-8466-085b010e186c req-ab723d8d-2d8b-42c3-ba79-2092e9d0b837 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0941823 May 26 14:48:34.149005 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-62818d44-5b7f-468d-b22f-bc2e4f2932ca req-7d5dd393-b330-44fd-a78f-5b1fedbd7306 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736489 May 26 14:48:34.173879 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port cd553d24-bf3e-45c7-903e-b5459cf05099 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:48:34.179018 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port cd553d24-bf3e-45c7-903e-b5459cf05099 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:48:34.188801 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:34.229863 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:34.306584 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:34.334923 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd553d24-bf3e-45c7-903e-b5459cf05099'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:34.348446 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port cd553d24-bf3e-45c7-903e-b5459cf05099, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=cd553d24-bf3e-45c7-903e-b5459cf05099,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:34.354092 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:34.355439 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device ac07176b-6df8-402b-be15-ef2328d925a9 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:34.389436 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-51150ffc-9a6b-4a11-8785-acb4ade37e82 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:34.459790 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'code': 200} May 26 14:48:34.460447 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: ac07176b-6df8-402b-be15-ef2328d925a9 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:34.460795 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device ac07176b-6df8-402b-be15-ef2328d925a9 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:34.492570 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=cd553d24-bf3e-45c7-903e-b5459cf05099,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:34.496364 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:34.693778 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70688957-5355-4695-b9e6-e88f37c6bf1c req-42260d85-2502-441c-8660-a0cf9c61f9f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:34.695861 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-70688957-5355-4695-b9e6-e88f37c6bf1c req-42260d85-2502-441c-8660-a0cf9c61f9f1 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 1099 time: 0.0796595 May 26 14:48:34.719555 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Deleting port d256d0f7-b3e5-470b-9049-adf3e1632cbc {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:34.719923 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:34.739711 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-70688957-5355-4695-b9e6-e88f37c6bf1c req-dbb191a4-e5a6-47fd-89ab-8571f86904b5 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359571 May 26 14:48:34.957745 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] For port d256d0f7-b3e5-470b-9049-adf3e1632cbc, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d256d0f7-b3e5-470b-9049-adf3e1632cbc,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:34.958191 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:35.081430 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Calling delete_port for d256d0f7-b3e5-470b-9049-adf3e1632cbc owned by network:router_interface {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:35.339623 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:35.346080 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3cba3c5a-c782-4dec-998b-f693a1dff06b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:35.406226 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Pushing event deleted for resources: {'Port': ['ID=d256d0f7-b3e5-470b-9049-adf3e1632cbc,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:35.412094 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:35.587765 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b066395-921c-4685-be0f-0abd544c30f8 req-3a02aa81-5ff2-4940-9989-6a5663e9afcc tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:35.589210 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8b066395-921c-4685-be0f-0abd544c30f8 req-3a02aa81-5ff2-4940-9989-6a5663e9afcc tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 946 time: 0.3386090 May 26 14:48:35.633925 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f47a693-3a71-4cc8-b142-52f13df6d60a req-99376734-4296-497c-a888-e4b5ab045e50 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:35.635478 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5f47a693-3a71-4cc8-b142-52f13df6d60a req-99376734-4296-497c-a888-e4b5ab045e50 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 945 time: 0.3488057 May 26 14:48:35.758893 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8b066395-921c-4685-be0f-0abd544c30f8 req-b5aa24e3-0131-4a6c-a26e-fca10788f523 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1585937 May 26 14:48:35.785520 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5f47a693-3a71-4cc8-b142-52f13df6d60a req-aca47f09-6e72-4220-b5a4-711ca2497df1 tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/security-groups?id=64c1268a-f654-4e14-ae1b-bd51c9de792c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1348710 May 26 14:48:35.786089 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:36.170028 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-968349b3-ae6d-4945-a7f4-d5fa263ecf2f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:36.171602 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-968349b3-ae6d-4945-a7f4-d5fa263ecf2f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Synchronizing usage tracker for tenant:d1a7192ff14647f894360c51e8ceac5b on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:48:36.188655 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-968349b3-ae6d-4945-a7f4-d5fa263ecf2f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Unset dirty status for tenant:d1a7192ff14647f894360c51e8ceac5b on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:48:36.189771 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-968349b3-ae6d-4945-a7f4-d5fa263ecf2f tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.79 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 945 time: 0.1823840 May 26 14:48:36.205999 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Router 7cd46f66-75af-44f8-b523-9201f57ddbda has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:48:36.335833 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Deleting port 21777a95-a516-4d1b-9651-8cb80f5079e5 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:36.336171 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:36.480895 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] For port 21777a95-a516-4d1b-9651-8cb80f5079e5, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=21777a95-a516-4d1b-9651-8cb80f5079e5,segment=NetworkSegment(dbc923bc-953d-4379-ac99-a42c93117401),segment_id=dbc923bc-953d-4379-ac99-a42c93117401)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:36.481257 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:36.513961 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:48:36.525785 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] Sync routers for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:48:36.528814 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c629d1e6-f28f-40d2-a05d-3e7b436b38bc admin admin] 10.222.0.72 "PUT /v2.0/routers/7cd46f66-75af-44f8-b523-9201f57ddbda/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0785382 May 26 14:48:36.531520 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45770) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:36.540825 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:36.541448 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:48:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:36.613307 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Calling delete_port for 21777a95-a516-4d1b-9651-8cb80f5079e5 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:36.714940 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks [] for router, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:36.737450 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:36.738224 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:36.749876 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-eea85a38-a156-4d3b-aed2-2228f6e8ea1b tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:36.872952 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Pushing event deleted for resources: {'Port': ['ID=21777a95-a516-4d1b-9651-8cb80f5079e5,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:36.875422 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] No DVR routers for this DVR port 21777a95-a516-4d1b-9651-8cb80f5079e5 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:48:36.877565 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:36.878764 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:36.881483 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '10a83137-2800-40d3-a8bf-09ac94a9f881', 'name': 'network-vif-deleted', 'tag': '21777a95-a516-4d1b-9651-8cb80f5079e5'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:36.904574 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-548dda3b-f8f5-487a-ae78-5eeedb6c9ea3 req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.79 "DELETE /v2.0/ports/21777a95-a516-4d1b-9651-8cb80f5079e5 HTTP/1.1" status: 204 len: 173 time: 0.7078314 May 26 14:48:36.917272 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:37.054260 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8f5533b7-7236-4f16-b551-bf27c8b7bba7 req-09a15d78-e1df-468a-9f37-45d22c2ae17d tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] 10.222.0.72 "GET /v2.0/ports?device_id=10a83137-2800-40d3-a8bf-09ac94a9f881 HTTP/1.1" status: 200 len: 210 time: 0.0806279 May 26 14:48:37.062155 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113'}], 'enable_snat': True}, 'gw_port_id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:48:35Z', 'revision_number': 5, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port': {'id': 'aa37aebf-292b-4506-965f-080ccf860b05', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:2b:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'device_owner': 'network:router_gateway', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:08Z', 'updated_at': '2021-05-26T14:44:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:37.066534 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] Checking router: 7cd46f66-75af-44f8-b523-9201f57ddbda for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:48:37.077683 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] Routers {'7cd46f66-75af-44f8-b523-9201f57ddbda'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:37.078343 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:48:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['7cd46f66-75af-44f8-b523-9201f57ddbda'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:37.127977 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '10a83137-2800-40d3-a8bf-09ac94a9f881', 'name': 'network-vif-deleted', 'tag': '21777a95-a516-4d1b-9651-8cb80f5079e5', 'status': 'completed', 'code': 200} May 26 14:48:37.131605 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bfef04b-e3aa-42b3-9e00-5c67add72973 req-3461e745-0cbc-41cf-ab46-10dea05bdc5a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:37.133160 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1bfef04b-e3aa-42b3-9e00-5c67add72973 req-3461e745-0cbc-41cf-ab46-10dea05bdc5a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 946 time: 0.2119582 May 26 14:48:37.142683 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Deleting port aa37aebf-292b-4506-965f-080ccf860b05 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:37.143044 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:37.287828 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] Set router 7cd46f66-75af-44f8-b523-9201f57ddbda gateway port host: None {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:37.289095 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1bfef04b-e3aa-42b3-9e00-5c67add72973 req-670e5ac1-1585-40f9-8fae-811a3e5cf256 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1485245 May 26 14:48:37.315205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] For port aa37aebf-292b-4506-965f-080ccf860b05, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=aa37aebf-292b-4506-965f-080ccf860b05,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:37.315572 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:37.410330 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:48:36Z', 'revision_number': 6, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:37.414630 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c985b72-9440-4849-add7-5f7a1a6fcfde None None] The sync data for ids ['7cd46f66-75af-44f8-b523-9201f57ddbda'] in dv-cinder-774594-6-iscsi is: [{'id': '7cd46f66-75af-44f8-b523-9201f57ddbda', 'name': 'tempest-TestMinimumBasicScenario-1314575991-router', 'tenant_id': '3defae92a9a1480c9278cae3445f9617', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:07Z', 'updated_at': '2021-05-26T14:48:36Z', 'revision_number': 6, 'project_id': '3defae92a9a1480c9278cae3445f9617', 'gw_port_host': None}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:48:37.447338 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Calling delete_port for aa37aebf-292b-4506-965f-080ccf860b05 owned by network:router_gateway {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:37.554135 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d46a35e-5c2c-44b0-9569-bccca4f26204 req-6fe237ae-3d25-48ce-913e-aaabffe45d0d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:37.555605 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3d46a35e-5c2c-44b0-9569-bccca4f26204 req-6fe237ae-3d25-48ce-913e-aaabffe45d0d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 946 time: 0.1181502 May 26 14:48:37.565019 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45790) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:37.579224 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Request body: {'floatingip': {'port_id': 'cd553d24-bf3e-45c7-903e-b5459cf05099'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:48:37.620129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45794) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:37.664127 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:37.743829 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:37.760097 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:37.764443 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Usage tracker for resource:security_group_rule and tenant:32de3eb4e7644759b345f3b52892b978 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:37.767563 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:37.773750 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:37.867789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:37.878499 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:37.889359 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e0dba12f-8d56-4fb7-9dcd-20484e4442c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:37.930593 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=32de3eb4e7644759b345f3b52892b978&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3092678 May 26 14:48:37.931514 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e65e1ed5-a837-4c31-861e-d46ad7509cf2,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:37.933839 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45800) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:37.936540 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:37.997392 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-90e89238-4233-4895-b6d7-2b90ec8979f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.027426 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-90e89238-4233-4895-b6d7-2b90ec8979f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.091477 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-90e89238-4233-4895-b6d7-2b90ec8979f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.096429 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9736afaa-1393-46f3-b7fe-36f15b4cb637 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:38.109367 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90e89238-4233-4895-b6d7-2b90ec8979f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e65e1ed5-a837-4c31-861e-d46ad7509cf2,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:38.116656 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-90e89238-4233-4895-b6d7-2b90ec8979f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:38.118543 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-90e89238-4233-4895-b6d7-2b90ec8979f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.121430 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-90e89238-4233-4895-b6d7-2b90ec8979f4 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/e65e1ed5-a837-4c31-861e-d46ad7509cf2 HTTP/1.1" status: 204 len: 168 time: 0.1856842 May 26 14:48:38.128847 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.138266 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 21777a95-a516-4d1b-9651-8cb80f5079e5 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:38.174734 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 21777a95-a516-4d1b-9651-8cb80f5079e5 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:38.175089 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 21777a95-a516-4d1b-9651-8cb80f5079e5 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:38.208877 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5493de51-b9b7-4ba2-b8b5-b33602daafd4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:38.301782 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device aa37aebf-292b-4506-965f-080ccf860b05 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:38.302636 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Pushing event deleted for resources: {'Port': ['ID=aa37aebf-292b-4506-965f-080ccf860b05,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:38.335465 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:38.388041 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: aa37aebf-292b-4506-965f-080ccf860b05 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:38.388595 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device aa37aebf-292b-4506-965f-080ccf860b05 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:38.389214 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d256d0f7-b3e5-470b-9049-adf3e1632cbc no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:38.458782 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.464637 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: d256d0f7-b3e5-470b-9049-adf3e1632cbc {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:38.465404 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d256d0f7-b3e5-470b-9049-adf3e1632cbc not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:38.559000 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45814) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:38.582713 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.602586 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:38.610282 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Usage tracker for resource:security_group_rule and tenant:8acc45b97eb14e5b884f154b3a63e97d is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:38.613689 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:38.621722 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:38.656860 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.660190 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.699535 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.700183 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7cd46f66-75af-44f8-b523-9201f57ddbda {{(pid=98445) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:48:38.735326 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.739792 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.741205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.745095 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] 10.222.0.72 "DELETE /v2.0/routers/7cd46f66-75af-44f8-b523-9201f57ddbda HTTP/1.1" status: 204 len: 168 time: 2.2099080 May 26 14:48:38.745369 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45822) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:38.761006 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-74cdc4a3-0421-4206-86b3-5ac646968c36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:38.789251 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=8acc45b97eb14e5b884f154b3a63e97d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2288918 May 26 14:48:38.792413 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45826) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:38.805032 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=837d154d-0782-4119-90f2-2851680ff62b,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:38.809199 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:38.866897 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fd0b2cd7-a7b9-41f0-b857-8a9b4f606922 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.892879 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fd0b2cd7-a7b9-41f0-b857-8a9b4f606922 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.899416 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_v2 [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] Deleting subnet 466228a3-069c-4ecc-9790-37e83a8604c9 {{(pid=98445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:48:38.903819 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.931202 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.937949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.955652 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fd0b2cd7-a7b9-41f0-b857-8a9b4f606922 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.960570 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-02318ab5-c312-4622-8b78-845909cbaf15 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:38.973391 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd0b2cd7-a7b9-41f0-b857-8a9b4f606922 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=837d154d-0782-4119-90f2-2851680ff62b,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:38.975976 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fd0b2cd7-a7b9-41f0-b857-8a9b4f606922 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:38.977152 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fd0b2cd7-a7b9-41f0-b857-8a9b4f606922 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:38.978232 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-fd0b2cd7-a7b9-41f0-b857-8a9b4f606922 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/837d154d-0782-4119-90f2-2851680ff62b HTTP/1.1" status: 204 len: 168 time: 0.1848319 May 26 14:48:39.031258 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2677826'] for subnet, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:39.216408 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.l3_db [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Floating IP 2385c9dd-c299-4860-8523-d1b1d53341c4 associated. External IP: 172.27.3.156, port: cd553d24-bf3e-45c7-903e-b5459cf05099. May 26 14:48:39.308306 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:39.898968 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Router 3865f36a-0ff1-4ceb-997f-e7f4306675ef has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:48:39.986067 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2332920', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2577448'] for subnet, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.000362 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-2a23ea93-f91e-49a1-8a64-f31647aca39b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:40.044500 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=466228a3-069c-4ecc-9790-37e83a8604c9,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:40.050166 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.052356 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72188bf4-5901-48c1-81ab-c10f837201f1 None None] Network f37261a9-5fa8-47e1-88e3-772578212058 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:48:40.053912 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:40.127929 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-008563f5-c9f7-4010-976f-8956c6e932bf admin admin] 10.222.0.72 "DELETE /v2.0/subnets/466228a3-069c-4ecc-9790-37e83a8604c9 HTTP/1.1" status: 204 len: 168 time: 1.3793018 May 26 14:48:40.128292 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45866) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:40.168732 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:48:40.174108 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.179186 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] Sync routers for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:48:40.193588 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:40.195958 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:48:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:40.253886 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6dba4c73-cdca-4a0f-8458-8f3ee124b838 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "PUT /v2.0/floatingips/2385c9dd-c299-4860-8523-d1b1d53341c4 HTTP/1.1" status: 200 len: 992 time: 2.6757715 May 26 14:48:40.255252 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'tag': 'cd553d24-bf3e-45c7-903e-b5459cf05099'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:48:40.348400 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] DHCP port deletion for f37261a9-5fa8-47e1-88e3-772578212058 request from dv-cinder-774594-6-iscsi {{(pid=98446) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 26 14:48:40.349029 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'tag': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'status': 'completed', 'code': 200} May 26 14:48:40.380161 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.446819 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] Deleting port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc {{(pid=98446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:40.447513 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.469765 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:40.489064 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Deleting port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:40.489557 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.559526 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] For port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:40.559946 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.610966 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] For port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,segment=NetworkSegment(19ef5432-879a-4038-8a6a-666cab9adc78),segment_id=19ef5432-879a-4038-8a6a-666cab9adc78)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:40.611831 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.709179 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] Calling delete_port for ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc owned by network:dhcp {{(pid=98446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:40.853851 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Calling delete_port for ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc owned by network:dhcp {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:40.885059 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '2385c9dd-c299-4860-8523-d1b1d53341c4', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'floating_ip_address': '172.27.3.156', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'port_id': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 468, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'mac_address': 'fa:16:3e:74:10:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:48:08Z', 'updated_at': '2021-05-26T14:48:38Z', 'revision_number': 1, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:40.890200 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] Checking router: 3865f36a-0ff1-4ceb-997f-e7f4306675ef for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:48:40.899731 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:40.900901 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:48:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:40.910629 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933'] for port, after_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.916590 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:40.922228 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:40.927311 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b7d01874-ccf2-4553-9e89-67d88a1c6601 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:40.966048 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] Pushing event deleted for resources: {'Port': ['ID=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,revision_number=None']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:40.968498 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] No DVR routers for this DVR port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc on host dv-cinder-774594-6-iscsi {{(pid=98446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:48:40.969990 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:40.978651 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Pushing event deleted for resources: {'Port': ['ID=ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:40.982254 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:40.982875 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] No DVR routers for this DVR port ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc on host dv-cinder-774594-6-iscsi {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:48:41.106462 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:41.112211 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:41.135640 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f37261a9-5fa8-47e1-88e3-772578212058']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:41.172664 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '19ef5432-879a-4038-8a6a-666cab9adc78') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:41.173192 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '19ef5432-879a-4038-8a6a-666cab9adc78') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:41.189218 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:41.206699 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:41.213437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Releasing vlan 1108 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:48:41.213828 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: util.warn( May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: util.warn( May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: util.warn( May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: util.warn( May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:48:41.227266 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:48:41.303433 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:41.308803 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-911c6299-4e7b-406b-b418-ca2a90f18b41 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:41.328021 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:41.338742 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Pushing event deleted for resources: {'Network': ['ID=f37261a9-5fa8-47e1-88e3-772578212058,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:41.341909 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:41.354796 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] 10.222.0.72 "DELETE /v2.0/networks/f37261a9-5fa8-47e1-88e3-772578212058 HTTP/1.1" status: 204 len: 168 time: 1.2254469 May 26 14:48:41.358043 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 45904) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:41.490163 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '2385c9dd-c299-4860-8523-d1b1d53341c4', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'floating_ip_address': '172.27.3.156', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'port_id': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 468, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'mac_address': 'fa:16:3e:74:10:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:48:08Z', 'updated_at': '2021-05-26T14:48:38Z', 'revision_number': 1, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:41.494749 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc3ed850-9709-4615-b85b-594c54b1eb1e None None] The sync data for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi is: [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '2385c9dd-c299-4860-8523-d1b1d53341c4', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'floating_ip_address': '172.27.3.156', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'port_id': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 468, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'mac_address': 'fa:16:3e:74:10:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:48:08Z', 'updated_at': '2021-05-26T14:48:38Z', 'revision_number': 1, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:48:41.745947 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06fb8ec0-71ab-4abe-a9e3-21f404c346af None None] New status for floating IP 2385c9dd-c299-4860-8523-d1b1d53341c4: ACTIVE {{(pid=98446) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:48:41.921002 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:42.080015 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:42.121245 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:42.121658 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device ad1fb3c5-fd79-4750-ba1e-c2b93e345fcc not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:42.466639 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Deleting port 0c91d007-7b10-44b3-a3b6-7b6993452f98 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:42.467285 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:42.588530 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] For port 0c91d007-7b10-44b3-a3b6-7b6993452f98, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=0c91d007-7b10-44b3-a3b6-7b6993452f98,segment=NetworkSegment(4adb3784-0b4e-4b28-bcc1-ba118c24af86),segment_id=4adb3784-0b4e-4b28-bcc1-ba118c24af86)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:42.588767 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:42.713081 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Calling delete_port for 0c91d007-7b10-44b3-a3b6-7b6993452f98 owned by network:router_interface {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:43.007016 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:43.010557 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-03bb5c7f-cdc8-41fb-975a-dd6cc5f06828 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:43.052299 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Pushing event deleted for resources: {'Port': ['ID=0c91d007-7b10-44b3-a3b6-7b6993452f98,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:43.055381 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:43.374483 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-d29b2387-3ee0-4c5c-a43f-c8061c671ddf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:43.375981 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-d29b2387-3ee0-4c5c-a43f-c8061c671ddf service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=c906c656a3474e64ab918724c042f2be&device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 1099 time: 0.2323108 May 26 14:48:43.404714 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:43.752525 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-d9254e80-e2dc-4730-a314-4901c0c36bde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:43.753964 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-d9254e80-e2dc-4730-a314-4901c0c36bde service neutron] 10.222.0.79 "GET /v2.0/networks?id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 200 len: 913 time: 0.3702192 May 26 14:48:43.931780 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-dfcb5292-3609-4d29-ba38-0d821f428100 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cd553d24-bf3e-45c7-903e-b5459cf05099 HTTP/1.1" status: 200 len: 1002 time: 0.1701794 May 26 14:48:44.077922 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-c7be44b2-85d1-4aec-a9a1-d03706d3e697 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:44.079463 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-c7be44b2-85d1-4aec-a9a1-d03706d3e697 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 200 len: 850 time: 0.1401298 May 26 14:48:44.089579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Router 062edae0-d41c-480c-8f65-df561aba5774 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:48:44.318192 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-d2cfe48f-8c42-4548-8468-cc0e180eab8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:48:44.319760 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-d2cfe48f-8c42-4548-8468-cc0e180eab8e service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=82f940d8-9b5b-4a1a-9b79-05f05dbfa116&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2324073 May 26 14:48:44.349120 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:48:44.360637 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] Sync routers for ids ['062edae0-d41c-480c-8f65-df561aba5774'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:48:44.373127 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] Routers {'062edae0-d41c-480c-8f65-df561aba5774'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:44.374038 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:48:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['062edae0-d41c-480c-8f65-df561aba5774'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:44.412135 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] 10.222.0.72 "PUT /v2.0/routers/062edae0-d41c-480c-8f65-df561aba5774/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0526221 May 26 14:48:44.414798 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45942) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:44.517899 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-a33a8860-afd5-4be1-b462-94f63bcfbb7a service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1867416 May 26 14:48:44.618251 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] Set router 062edae0-d41c-480c-8f65-df561aba5774 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:44.660814 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks [] for router, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:44.798478 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d537da53-c3e8-4b5b-b9c1-4f3fc075f9fc req-45526832-6444-4a19-999a-8a77d726ecb6 service neutron] 10.222.0.79 "GET /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2728176 May 26 14:48:44.859690 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:44.943558 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252'}], 'enable_snat': True}, 'gw_port_id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:48:42Z', 'revision_number': 5, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port': {'id': '00d2d99f-c77d-4827-9e5d-5d2cf76070fd', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:f4:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '062edae0-d41c-480c-8f65-df561aba5774', 'device_owner': 'network:router_gateway', 'standard_attr_id': 286, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:44:17Z', 'updated_at': '2021-05-26T14:44:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:44.949821 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] Checking router: 062edae0-d41c-480c-8f65-df561aba5774 for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:48:44.952977 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Deleting port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:44.953320 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:44.959420 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] Routers {'062edae0-d41c-480c-8f65-df561aba5774'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:48:44.960055 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:48:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['062edae0-d41c-480c-8f65-df561aba5774'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:45.087156 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] For port 00d2d99f-c77d-4827-9e5d-5d2cf76070fd, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=00d2d99f-c77d-4827-9e5d-5d2cf76070fd,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:45.087586 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:45.119897 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] Set router 062edae0-d41c-480c-8f65-df561aba5774 gateway port host: None {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:48:45.231437 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:48:44Z', 'revision_number': 6, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:45.235989 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bf79ff4-e1e8-4668-9755-f279de127fdc None None] The sync data for ids ['062edae0-d41c-480c-8f65-df561aba5774'] in dv-cinder-774594-6-iscsi is: [{'id': '062edae0-d41c-480c-8f65-df561aba5774', 'name': 'tempest-TestMinimumBasicScenario-1144548630-router', 'tenant_id': '91aab1b1c8f643b5a396e20256a142c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:44:16Z', 'updated_at': '2021-05-26T14:48:44Z', 'revision_number': 6, 'project_id': '91aab1b1c8f643b5a396e20256a142c6', 'gw_port_host': None}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:48:45.341158 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Calling delete_port for 00d2d99f-c77d-4827-9e5d-5d2cf76070fd owned by network:router_gateway {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:45.481519 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:45.485238 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-002a7ef0-0898-4ddb-bcfa-8b1fc7823c5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:45.533101 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Pushing event deleted for resources: {'Port': ['ID=00d2d99f-c77d-4827-9e5d-5d2cf76070fd,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:45.558432 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:45.623656 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:45.800121 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:45.802486 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:45.825430 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:45.826110 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 062edae0-d41c-480c-8f65-df561aba5774 {{(pid=98445) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:48:45.839193 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:45.840245 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] 10.222.0.72 "DELETE /v2.0/routers/062edae0-d41c-480c-8f65-df561aba5774 HTTP/1.1" status: 204 len: 168 time: 1.4244874 May 26 14:48:45.842925 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45962) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:45.911056 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_v2 [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] Deleting subnet 67eca565-c006-4f3d-aa95-7b676123e9ba {{(pid=98445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:48:45.914006 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:45.968059 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2677826'] for subnet, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:46.062864 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:46.099937 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 0c91d007-7b10-44b3-a3b6-7b6993452f98 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:46.156352 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 0c91d007-7b10-44b3-a3b6-7b6993452f98 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:46.156948 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 0c91d007-7b10-44b3-a3b6-7b6993452f98 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:46.165715 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 00d2d99f-c77d-4827-9e5d-5d2cf76070fd no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:46.208387 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 00d2d99f-c77d-4827-9e5d-5d2cf76070fd {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:46.209171 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 00d2d99f-c77d-4827-9e5d-5d2cf76070fd not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:46.412682 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2332920', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2577448'] for subnet, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:46.427893 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5c58dc93-805c-42c0-83ee-7f92f0f5a983 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:46.465453 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:46.474736 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=67eca565-c006-4f3d-aa95-7b676123e9ba,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:46.475780 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09b6f5bd-cbf0-4e14-9d98-c54f53366a00 None None] Network 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:48:46.477841 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/67eca565-c006-4f3d-aa95-7b676123e9ba HTTP/1.1" status: 204 len: 168 time: 0.6339798 May 26 14:48:46.478885 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f09e3203-d9ef-495b-9988-88ead82c79e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:46.480316 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 45984) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:46.597260 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:46.675498 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Deleting port c5e2da0e-7659-40f1-82f7-05210e4c2bca {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:46.675821 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:46.735225 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] DHCP port deletion for 9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da request from dv-cinder-774594-6-iscsi {{(pid=98446) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 26 14:48:46.776567 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] For port c5e2da0e-7659-40f1-82f7-05210e4c2bca, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=c5e2da0e-7659-40f1-82f7-05210e4c2bca,segment=NetworkSegment(4adb3784-0b4e-4b28-bcc1-ba118c24af86),segment_id=4adb3784-0b4e-4b28-bcc1-ba118c24af86)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:46.776932 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:46.802593 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] Deleting port c5e2da0e-7659-40f1-82f7-05210e4c2bca {{(pid=98446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:48:46.802962 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:46.904434 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] For port c5e2da0e-7659-40f1-82f7-05210e4c2bca, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=c5e2da0e-7659-40f1-82f7-05210e4c2bca,segment=NetworkSegment(4adb3784-0b4e-4b28-bcc1-ba118c24af86),segment_id=4adb3784-0b4e-4b28-bcc1-ba118c24af86)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:48:46.904851 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.005318 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Calling delete_port for c5e2da0e-7659-40f1-82f7-05210e4c2bca owned by network:dhcp {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:47.025764 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] Calling delete_port for c5e2da0e-7659-40f1-82f7-05210e4c2bca owned by network:dhcp {{(pid=98446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:48:47.055269 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.059525 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3a16204a-2dbf-4f34-bad1-6d8b0f829850 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:47.070343 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933'] for port, after_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.074404 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:47.108603 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Pushing event deleted for resources: {'Port': ['ID=c5e2da0e-7659-40f1-82f7-05210e4c2bca,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:47.111168 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:47.113729 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] No DVR routers for this DVR port c5e2da0e-7659-40f1-82f7-05210e4c2bca on host dv-cinder-774594-6-iscsi {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:48:47.120515 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] Pushing event deleted for resources: {'Port': ['ID=c5e2da0e-7659-40f1-82f7-05210e4c2bca,revision_number=None']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:47.123449 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:47.124238 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] No DVR routers for this DVR port c5e2da0e-7659-40f1-82f7-05210e4c2bca on host dv-cinder-774594-6-iscsi {{(pid=98446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:48:47.235286 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.248788 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da']}} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:47.260947 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4adb3784-0b4e-4b28-bcc1-ba118c24af86') {'for_net_delete': True} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:47.261248 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4adb3784-0b4e-4b28-bcc1-ba118c24af86') {} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:48:47.272516 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2677883'] for segment, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.290347 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.299990 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Releasing vlan 1139 on physical network physnet1 to pool {{(pid=98445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:48:47.300544 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2334298'] for segment, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: Traceback (most recent call last): May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: timer() May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: cb(*args, **kw) May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: return func(*args, **kwargs) May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: self._notify() May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: self.callback(batched_events) May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: event.method(event) May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: return f(self, *a, **k) May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._get(url).json() May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: return self.request(url, 'GET', **kwargs) May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:48:47.315860 dv-cinder-774594-6-iscsi neutron-server[98445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:48:47.396153 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.401744 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f0b4740f-1c7e-497b-ae52-9417a8fe8b63 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:47.414544 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.426964 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Pushing event deleted for resources: {'Network': ['ID=9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:47.430658 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:47.433703 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-d7f6f7fd-0f00-47e1-aca2-5ca60aff5d93 admin admin] 10.222.0.72 "DELETE /v2.0/networks/9e2b06fc-a746-4bf0-b79c-5cc7fa5a67da HTTP/1.1" status: 204 len: 168 time: 0.9522150 May 26 14:48:47.630048 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46006) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:47.696569 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46010) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:47.698616 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-d25c1126-8243-49c2-8820-4b2506c7ebb5 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=3defae92a9a1480c9278cae3445f9617&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0660625 May 26 14:48:47.799394 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3413ff24-dc50-461d-bae8-748a73a41692 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.836823 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3413ff24-dc50-461d-bae8-748a73a41692 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.914188 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3413ff24-dc50-461d-bae8-748a73a41692 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.923571 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c0778ca3-222d-4058-8114-77813f002e37 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:47.937768 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3413ff24-dc50-461d-bae8-748a73a41692 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11048e68-75a2-4529-93aa-c6555fbd1fe1,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:47.940140 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-3413ff24-dc50-461d-bae8-748a73a41692 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:47.947497 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3413ff24-dc50-461d-bae8-748a73a41692 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:47.951097 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-3413ff24-dc50-461d-bae8-748a73a41692 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/11048e68-75a2-4529-93aa-c6555fbd1fe1 HTTP/1.1" status: 204 len: 168 time: 0.2493668 May 26 14:48:48.061132 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device c5e2da0e-7659-40f1-82f7-05210e4c2bca no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:48:48.098375 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: c5e2da0e-7659-40f1-82f7-05210e4c2bca {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:48:48.099093 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device c5e2da0e-7659-40f1-82f7-05210e4c2bca not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:48:48.321392 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46028) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:48.369342 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-5b2e0b81-e964-4d34-999c-c88c5f7c154a admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=91aab1b1c8f643b5a396e20256a142c6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0465574 May 26 14:48:48.372113 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46032) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:48.437111 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:48.465522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:48.521388 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:48.525359 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-979fc440-f4de-41a3-8f99-6355c4849fb1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:48.536824 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6281e1ea-f0e2-4c67-a0ed-fb56ffaba5de,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:48.547152 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.547532 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.547931 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.548285 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.548638 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.548988 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.549331 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.549650 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.550031 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.550402 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.550729 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.551069 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:48:48.562457 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:48.564615 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:48.568360 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/6281e1ea-f0e2-4c67-a0ed-fb56ffaba5de HTTP/1.1" status: 204 len: 168 time: 0.1930201 May 26 14:48:50.844202 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46082) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:50.997755 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.012511 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:51.016543 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Usage tracker for resource:security_group_rule and tenant:6e4b366309f346cba4dfd37a2bf229b4 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:51.019406 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:51.025255 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:51.110822 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.116104 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.123512 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c1920700-18fc-46bc-a5fe-3deb5ea8ec16 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:51.164781 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=243f9313-fd4e-4a96-9827-b46087bac614,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:51.167468 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:51.169992 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=6e4b366309f346cba4dfd37a2bf229b4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3247890 May 26 14:48:51.172722 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46088) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:51.235945 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20f98fcf-e6f3-4105-9417-4bd4a5596e7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.263225 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20f98fcf-e6f3-4105-9417-4bd4a5596e7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.321369 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20f98fcf-e6f3-4105-9417-4bd4a5596e7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.325958 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:51.337451 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f98fcf-e6f3-4105-9417-4bd4a5596e7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=243f9313-fd4e-4a96-9827-b46087bac614,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:51.339802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-20f98fcf-e6f3-4105-9417-4bd4a5596e7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:51.345785 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20f98fcf-e6f3-4105-9417-4bd4a5596e7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.346940 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-20f98fcf-e6f3-4105-9417-4bd4a5596e7a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/243f9313-fd4e-4a96-9827-b46087bac614 HTTP/1.1" status: 204 len: 168 time: 0.1733003 May 26 14:48:51.632132 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b1c0f4b8-5e1b-4134-9507-d0da18d2a152 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.642350 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46098) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:51.660301 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.674513 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:51.678511 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Usage tracker for resource:security_group_rule and tenant:53a13a10ec44409db2196db3ef49a735 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:51.681368 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:51.687059 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:51.769753 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.775979 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.782324 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-0009539f-c03a-47f7-afbb-1f684396804f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:51.826075 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=53a13a10ec44409db2196db3ef49a735&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1826153 May 26 14:48:51.826931 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b983098-ace5-4bc3-a74f-e09f3818b10f,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:51.829574 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46102) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:51.830278 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:51.894279 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fddaa9f9-064d-4969-a356-25f59008e0d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.919654 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fddaa9f9-064d-4969-a356-25f59008e0d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.976594 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fddaa9f9-064d-4969-a356-25f59008e0d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:51.980385 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ad09c16c-f340-4fd0-89f1-c833acad3433 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:51.991225 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fddaa9f9-064d-4969-a356-25f59008e0d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b983098-ace5-4bc3-a74f-e09f3818b10f,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:51.994826 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fddaa9f9-064d-4969-a356-25f59008e0d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:51.998148 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fddaa9f9-064d-4969-a356-25f59008e0d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:52.004136 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-fddaa9f9-064d-4969-a356-25f59008e0d8 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9b983098-ace5-4bc3-a74f-e09f3818b10f HTTP/1.1" status: 204 len: 168 time: 0.1700749 May 26 14:48:52.385110 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46110) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:52.403981 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:52.419358 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:48:52.423630 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Usage tracker for resource:security_group_rule and tenant:9b56b45291354dea983b9a4e29dd9533 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:48:52.426673 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:48:52.432900 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:48:52.520245 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:52.524720 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:52.531439 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-da410234-bd1f-4545-bddb-268869e51117 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:52.571053 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=9b56b45291354dea983b9a4e29dd9533&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1848280 May 26 14:48:52.571926 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e302f9f-08b2-45ed-8b56-3cf994ea301a,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:52.574497 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46116) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:48:52.574967 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:52.637972 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-697924e2-58a0-4f8a-8563-2b0c7d6415bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:52.664055 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-697924e2-58a0-4f8a-8563-2b0c7d6415bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:52.717907 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-697924e2-58a0-4f8a-8563-2b0c7d6415bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:52.721826 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b1d325f4-1c95-40b3-b82f-f2cafa5c3aab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:48:52.735009 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697924e2-58a0-4f8a-8563-2b0c7d6415bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e302f9f-08b2-45ed-8b56-3cf994ea301a,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:48:52.738605 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-697924e2-58a0-4f8a-8563-2b0c7d6415bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:48:52.744205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-697924e2-58a0-4f8a-8563-2b0c7d6415bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:52.745604 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-697924e2-58a0-4f8a-8563-2b0c7d6415bb admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/5e302f9f-08b2-45ed-8b56-3cf994ea301a HTTP/1.1" status: 204 len: 168 time: 0.1700995 May 26 14:48:53.260796 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-db8cce9c-5f00-4e3b-9a70-dc5594982bdd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:54.578375 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:55.847981 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:55.909544 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:48:57.481938 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:03.133837 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46280) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:03.267269 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:03.282204 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:03.286392 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Usage tracker for resource:security_group_rule and tenant:8093e1e6c0ef4dfcae6ecf94ffa62305 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:03.289287 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:03.295585 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:03.383185 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:03.388665 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:03.395943 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c11b83d4-c911-4482-9be0-7f0a5af29412 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:03.437477 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=8093e1e6c0ef4dfcae6ecf94ffa62305&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3025234 May 26 14:49:03.438441 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6ff7ab9-0415-40d8-ba7e-f7729d410434,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:03.440226 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46290) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:03.441556 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:03.506897 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-778b62e1-eacb-44bd-be26-a80511ba67f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:03.532887 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-778b62e1-eacb-44bd-be26-a80511ba67f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:03.586171 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-778b62e1-eacb-44bd-be26-a80511ba67f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:03.590341 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-49538cbb-5384-404a-95c3-299528cbc758 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:03.602874 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778b62e1-eacb-44bd-be26-a80511ba67f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6ff7ab9-0415-40d8-ba7e-f7729d410434,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:03.605391 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-778b62e1-eacb-44bd-be26-a80511ba67f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:03.614565 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-778b62e1-eacb-44bd-be26-a80511ba67f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:03.618115 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-778b62e1-eacb-44bd-be26-a80511ba67f5 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a6ff7ab9-0415-40d8-ba7e-f7729d410434 HTTP/1.1" status: 204 len: 168 time: 0.1743443 May 26 14:49:06.291134 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46332) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:06.353607 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_v2 [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] Deleting subnet 7943e8a1-ce31-4420-87bb-233f0b2070de {{(pid=98445) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:49:06.357227 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:06.410727 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2677826'] for subnet, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:06.468827 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:06.720188 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2332920', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2577448'] for subnet, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:06.725133 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:06.760001 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7943e8a1-ce31-4420-87bb-233f0b2070de,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:06.761680 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:06.768025 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:06.776338 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-d90333df-6b7e-407d-81d0-df83f8296279 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/7943e8a1-ce31-4420-87bb-233f0b2070de HTTP/1.1" status: 204 len: 168 time: 0.4818814 May 26 14:49:06.776626 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46340) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:06.978733 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.102713 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.116708 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['149051aa-2259-48fd-9599-39a44ad33762']}} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:07.128844 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dbc923bc-953d-4379-ac99-a42c93117401') {'for_net_delete': True} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:07.129135 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dbc923bc-953d-4379-ac99-a42c93117401') {} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:07.140516 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2677883'] for segment, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.157906 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.164879 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Releasing vlan 1133 on physical network physnet1 to pool {{(pid=98445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:49:07.164984 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2334298'] for segment, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: Traceback (most recent call last): May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: timer() May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: cb(*args, **kw) May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: return func(*args, **kwargs) May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: self._notify() May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: self.callback(batched_events) May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: event.method(event) May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: return f(self, *a, **k) May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._get(url).json() May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: return self.request(url, 'GET', **kwargs) May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:49:07.179101 dv-cinder-774594-6-iscsi neutron-server[98445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:49:07.261405 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.265832 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:07.278582 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.288983 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Pushing event deleted for resources: {'Network': ['ID=149051aa-2259-48fd-9599-39a44ad33762,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:07.292269 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:07.298758 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-dec8ae0a-90d8-441b-81f9-8e4702938e32 admin admin] 10.222.0.72 "DELETE /v2.0/networks/149051aa-2259-48fd-9599-39a44ad33762 HTTP/1.1" status: 204 len: 168 time: 0.5211520 May 26 14:49:07.490172 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46346) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:07.540770 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-22ade914-c08d-42a8-8294-8204ca2d00da admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d1a7192ff14647f894360c51e8ceac5b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0491478 May 26 14:49:07.543213 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46350) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:07.602340 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.628608 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.685810 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.691100 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8bf7c482-6c4d-4374-9413-aee29c6f945f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:07.704376 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64c1268a-f654-4e14-ae1b-bd51c9de792c,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:07.714395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.714760 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.715114 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.715461 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.715802 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.716151 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.716493 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.716833 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.717177 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.717508 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.717838 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.718164 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:07.721699 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:07.722627 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:07.726577 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/64c1268a-f654-4e14-ae1b-bd51c9de792c HTTP/1.1" status: 204 len: 168 time: 0.1821697 May 26 14:49:09.225632 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:49:21.648033 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-015467b1-9f70-4992-8c64-21ace7b489ee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:23.272939 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1d8253d6-5731-4f02-a8c7-9b8b7f235ff9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:24.562493 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:25.240979 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5510714-372c-4145-9fbc-675231c14056 req-fd223f80-bdb3-45a3-af7f-d6a4e246c1a5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:25.242479 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a5510714-372c-4145-9fbc-675231c14056 req-fd223f80-bdb3-45a3-af7f-d6a4e246c1a5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0866981 May 26 14:49:25.293570 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a5510714-372c-4145-9fbc-675231c14056 req-505e8194-8fa9-46f1-aa4d-b515ecb6cc08 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422046 May 26 14:49:25.863027 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:25.903296 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:26.502053 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19f9b46c-b126-4e89-90c2-505acb5acc10 req-3db9c40f-9f30-4e4e-9337-9350605744d8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:26.503552 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-19f9b46c-b126-4e89-90c2-505acb5acc10 req-3db9c40f-9f30-4e4e-9337-9350605744d8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0864837 May 26 14:49:26.549391 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-19f9b46c-b126-4e89-90c2-505acb5acc10 req-1fccd739-834f-49a6-8e72-952887285b02 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400066 May 26 14:49:27.494264 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:27.757837 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8244752-c9ce-40a1-839d-1446ad643355 req-4c318b42-cddf-490a-ad20-4f43a4aa2d21 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:27.759317 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b8244752-c9ce-40a1-839d-1446ad643355 req-4c318b42-cddf-490a-ad20-4f43a4aa2d21 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0854464 May 26 14:49:27.807462 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b8244752-c9ce-40a1-839d-1446ad643355 req-fbc73d0c-4a3d-4447-b21e-b99238de126b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416076 May 26 14:49:29.012565 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ed1548-b185-4d22-9946-e25c682e51d1 req-03326ecc-9795-4c2c-bbb2-3233ef128e3d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:29.014041 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2ed1548-b185-4d22-9946-e25c682e51d1 req-03326ecc-9795-4c2c-bbb2-3233ef128e3d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0818555 May 26 14:49:29.064584 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a2ed1548-b185-4d22-9946-e25c682e51d1 req-9c9f0093-690b-4f09-9fc6-1f3d8cbd40e3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444543 May 26 14:49:29.202340 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46578) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:29.345304 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:29.361127 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:29.365203 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Usage tracker for resource:security_group_rule and tenant:44d392b1575c4939a980dc400dc76bfe is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:29.368266 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:29.374535 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:29.458957 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:29.463776 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:29.470895 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-944cb789-1316-44ab-b28c-e0ff0230e6a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:29.508611 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ed299ed-4da9-44f9-944c-31d9c6aad10e,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:29.512906 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=44d392b1575c4939a980dc400dc76bfe&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3095243 May 26 14:49:29.513845 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8e30b4b5-a42e-4beb-b0dc-16b61ac31afe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:29.515823 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46584) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:29.579655 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f7a7b1be-70bc-4e34-8f0e-be680f035570 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:29.606249 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f7a7b1be-70bc-4e34-8f0e-be680f035570 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:29.659793 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f7a7b1be-70bc-4e34-8f0e-be680f035570 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:29.664519 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:29.675949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a7b1be-70bc-4e34-8f0e-be680f035570 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ed299ed-4da9-44f9-944c-31d9c6aad10e,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:29.678850 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f7a7b1be-70bc-4e34-8f0e-be680f035570 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:29.680740 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-f7a7b1be-70bc-4e34-8f0e-be680f035570 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:29.681869 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f7a7b1be-70bc-4e34-8f0e-be680f035570 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/5ed299ed-4da9-44f9-944c-31d9c6aad10e HTTP/1.1" status: 204 len: 168 time: 0.1650729 May 26 14:49:30.265923 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1250df5-3e50-4776-82d5-ffd3664193a1 req-fcef822a-29da-492c-a3c3-c87e4c66e7b1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:30.267534 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1250df5-3e50-4776-82d5-ffd3664193a1 req-fcef822a-29da-492c-a3c3-c87e4c66e7b1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0884213 May 26 14:49:30.318933 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b1250df5-3e50-4776-82d5-ffd3664193a1 req-ba9418fc-a214-4324-8d3b-b9132a25260e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441453 May 26 14:49:30.414789 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46612) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:30.528839 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-842792017-network', 'tenant_id': '054087186333487b82b9a7a12d02c80f'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:30.536075 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:30.542072 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Usage tracker for resource:network and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:30.546634 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:30.554772 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:30.567777 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Made reservation on behalf of 054087186333487b82b9a7a12d02c80f for: {'network': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:49:30.570059 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:30.583168 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:30.597315 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:30.602207 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Usage tracker for resource:security_group_rule and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:30.605077 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:30.610933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:30.689683 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:30.695755 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:30.699642 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cdb1a56d-a249-4629-aa07-d9d57f84a591 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:30.722830 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1123} {{(pid=98445) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:49:30.735388 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14e5fd49-d455-4ac4-928f-ad6b0f0b99bb,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:30.739620 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:30.741067 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:30.741439 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.segments_db [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Added segment 38634d8d-479e-4c5f-9c7f-980524b5596f of type vlan for network 0a3b5429-9434-492a-ba57-3dfc671d164c May 26 14:49:30.768776 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:30.799395 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:30.800715 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:30.801276 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:30.805935 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:30.900951 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4847279 May 26 14:49:30.903949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46618) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:30.906624 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Pushing event updated for resources: {'Network': ['ID=0a3b5429-9434-492a-ba57-3dfc671d164c,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:30.911612 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Request body: {'subnet': {'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-842792017-subnet', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:30.914832 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:30.916993 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:30.917436 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 0a3b5429-9434-492a-ba57-3dfc671d164c details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:49:30.920939 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Usage tracker for resource:subnet and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:30.923874 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:30.929723 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:30.941840 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Made reservation on behalf of 054087186333487b82b9a7a12d02c80f for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:49:30.944341 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2577413'] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:31.341291 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2332857', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2577427'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:31.344837 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:31.408654 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Pushing event updated for resources: {'Subnet': ['ID=be983207-7be6-448d-b3eb-3c77c2c0eda1,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:31.412502 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:31.428305 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Checking segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:49:31.428657 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Network hostable DHCP agents. Network: 0a3b5429-9434-492a-ba57-3dfc671d164c, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:49:31.592737 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Network 0a3b5429-9434-492a-ba57-3dfc671d164c is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:49:31.606622 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 0a3b5429-9434-492a-ba57-3dfc671d164c) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:31.615578 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1266d72a-b78b-4d65-ae0c-d015121011ee None None] Network 0a3b5429-9434-492a-ba57-3dfc671d164c requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:49:31.618397 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:31.618976 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:31.638888 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790f8c4c-0152-4035-ac24-7757930f9a5c req-97326ebd-cfbc-4ca1-ba90-6468f546cfb8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:31.640376 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-790f8c4c-0152-4035-ac24-7757930f9a5c req-97326ebd-cfbc-4ca1-ba90-6468f546cfb8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.2088270 May 26 14:49:31.662564 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7576072 May 26 14:49:31.666217 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46626) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:31.671968 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:31.677100 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:31.681519 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Usage tracker for resource:router and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:31.684604 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:31.689262 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-790f8c4c-0152-4035-ac24-7757930f9a5c req-b20384ab-621a-4668-9dd1-fff7de4d0e8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419493 May 26 14:49:31.691251 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:31.705629 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:31.706825 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:31.721549 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:31.834176 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-0a3b5429-9434-492a-ba57-3dfc671d164c', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:49:31.835105 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:31.986568 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Allocated IP 172.20.0.2 (0a3b5429-9434-492a-ba57-3dfc671d164c/be983207-7be6-448d-b3eb-3c77c2c0eda1/e0a1890e-a3d3-4e7d-8c41-5e1c9be36402) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:49:32.095441 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.231281 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.242114 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Transition to ACTIVE for port object e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:32.261090 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Transition to ACTIVE for port object e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:32.267732 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.272644 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:32.332231 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Network 0a3b5429-9434-492a-ba57-3dfc671d164c is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:49:32.335184 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:32.338982 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:49:32.385183 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Pushing event updated for resources: {'Port': ['ID=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:32.431405 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.431765 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.432097 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.432424 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.432749 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.432881 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.433057 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.433379 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.433695 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.434014 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.434348 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.434667 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.434978 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:32.439698 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:32.446655 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Attempting to bind port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:49:32.447044 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Attempting to bind port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:49:32.447406 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Attempting to bind port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 on network 0a3b5429-9434-492a-ba57-3dfc671d164c {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:49:32.453178 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 49, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:49:32.453566 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Checking segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:49:32.453970 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.454382 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Bound using segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:49:32.454846 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Bound port: e0a1890e-a3d3-4e7d-8c41-5e1c9be36402, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:49:32.455219 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.464688 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.550816 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] For port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:49:32.553936 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] For port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:49:32.559070 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.562935 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:32.609380 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Allocated IP 172.27.3.41 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/d48a16a1-caa7-4814-bc94-b3d0bb60dff0) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:49:32.643196 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Pushing event updated for resources: {'Port': ['ID=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:32.648450 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:32.780902 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.820975 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:32.827011 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d46410a7-bfcf-424c-9d81-3098449df82b tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:32.957487 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:49:32.960744 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:32.965614 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:49:32.988209 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d637d9-5fc9-4814-90c3-76808e79ad36 req-82f1c83a-7d5e-4b16-a8bc-340aae93c640 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:32.989922 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-15d637d9-5fc9-4814-90c3-76808e79ad36 req-82f1c83a-7d5e-4b16-a8bc-340aae93c640 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1095192 May 26 14:49:33.005831 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Pushing event updated for resources: {'Port': ['ID=d48a16a1-caa7-4814-bc94-b3d0bb60dff0,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:33.018589 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:33.045961 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-15d637d9-5fc9-4814-90c3-76808e79ad36 req-ce6d1837-b692-4002-a7a9-39add29473f8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492821 May 26 14:49:33.498592 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:33.616315 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ab7a31e-a266-4e5d-aab2-7ae13d6843ff None None] Network 0a3b5429-9434-492a-ba57-3dfc671d164c requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:49:33.782793 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-4126e9e6-6992-4a08-950e-cb7e4a0022fb None None] Provisioning for port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:33.855135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:34.071797 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Router 39443462-555c-4ab6-8ab8-12514f6596b8 is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98444) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:49:34.143705 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:34.223304 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:34.229920 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:34.230600 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:34.269286 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:49:34.288426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:49:34.289962 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3cb8f53-6ef0-4914-b746-a5bc15d56f19 req-aeb643f6-7932-4fc4-ae96-7843927975d1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:34.292413 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f3cb8f53-6ef0-4914-b746-a5bc15d56f19 req-aeb643f6-7932-4fc4-ae96-7843927975d1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0964212 May 26 14:49:34.307957 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:34.308598 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:34.314376 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:34.318870 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.6514504 May 26 14:49:34.319647 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46652) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:34.360248 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f3cb8f53-6ef0-4914-b746-a5bc15d56f19 req-77d87cac-3801-47dc-984d-df7351a1035b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0600052 May 26 14:49:34.543100 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:34.568235 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:34.796598 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:34.804380 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:34.808317 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:34.977823 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:34.981853 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:35.009426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:33Z', 'revision_number': 3, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:35.013304 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:49:35.013644 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Updating router 39443462-555c-4ab6-8ab8-12514f6596b8 port d48a16a1-caa7-4814-bc94-b3d0bb60dff0 binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:49:35.068928 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.137745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.347168 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Allocated IP 172.20.0.1 (0a3b5429-9434-492a-ba57-3dfc671d164c/be983207-7be6-448d-b3eb-3c77c2c0eda1/2a366b9c-cef1-4539-9117-1fabfce12f8d) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:49:35.402923 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.414933 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Transition to ACTIVE for port object d48a16a1-caa7-4814-bc94-b3d0bb60dff0 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:35.421579 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.426067 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:35.504347 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.506289 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Attempting to bind port d48a16a1-caa7-4814-bc94-b3d0bb60dff0 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:49:35.506696 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Attempting to bind port d48a16a1-caa7-4814-bc94-b3d0bb60dff0 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:49:35.507061 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Attempting to bind port d48a16a1-caa7-4814-bc94-b3d0bb60dff0 on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:49:35.509238 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b555fb30-afcb-4c79-9ef3-61453a465d02 None None] Pushing event updated for resources: {'Port': ['ID=d48a16a1-caa7-4814-bc94-b3d0bb60dff0,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:35.512955 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-b555fb30-afcb-4c79-9ef3-61453a465d02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:35.515542 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 49, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:49:35.515916 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:49:35.516844 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.516844 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:49:35.517150 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Bound port: d48a16a1-caa7-4814-bc94-b3d0bb60dff0, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:49:35.517532 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.522532 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Transition to ACTIVE for port object 2a366b9c-cef1-4539-9117-1fabfce12f8d will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:35.548781 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.555076 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-91b39858-4469-4fe3-a09c-47b9207cf12f tempest-VolumesNegativeTest-800072892 tempest-VolumesNegativeTest-800072892-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:35.557105 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-923c10f5-00bd-4625-b035-57e81176665a req-b0fc21dc-ae0c-42e8-bbd7-d17ca8cd82d5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:35.565319 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-923c10f5-00bd-4625-b035-57e81176665a req-b0fc21dc-ae0c-42e8-bbd7-d17ca8cd82d5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0995159 May 26 14:49:35.599252 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] For port d48a16a1-caa7-4814-bc94-b3d0bb60dff0, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:49:35.603229 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] For port d48a16a1-caa7-4814-bc94-b3d0bb60dff0, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d48a16a1-caa7-4814-bc94-b3d0bb60dff0,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:49:35.609892 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.610763 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-923c10f5-00bd-4625-b035-57e81176665a req-5606c2f0-d481-4c56-8213-ce93be185831 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441098 May 26 14:49:35.614988 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:35.625354 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Network 0a3b5429-9434-492a-ba57-3dfc671d164c is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:49:35.639030 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:35.639030 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:49:35.695450 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Pushing event updated for resources: {'Port': ['ID=2a366b9c-cef1-4539-9117-1fabfce12f8d,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:35.698352 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:35.699207 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:35.699847 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:35.706510 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.754015 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b555fb30-afcb-4c79-9ef3-61453a465d02 None None] Pushing event updated for resources: {'Port': ['ID=d48a16a1-caa7-4814-bc94-b3d0bb60dff0,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:35.764106 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-b555fb30-afcb-4c79-9ef3-61453a465d02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:35.883202 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-f7189d47-c92a-4e1b-b59e-4cbaca4e5a98 None None] Provisioning for port 2a366b9c-cef1-4539-9117-1fabfce12f8d completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:35.892754 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-f7189d47-c92a-4e1b-b59e-4cbaca4e5a98 None None] Provisioning complete for port 2a366b9c-cef1-4539-9117-1fabfce12f8d triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:35.893149 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f7189d47-c92a-4e1b-b59e-4cbaca4e5a98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:35.919909 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:35.967244 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:36.120686 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-f7189d47-c92a-4e1b-b59e-4cbaca4e5a98 None None] Port 2a366b9c-cef1-4539-9117-1fabfce12f8d cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:49:36.122167 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:36.197003 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:36.202958 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:36.226771 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bfb12076-75a9-413c-b069-8c504cbc143d tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:36.264248 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:36.264622 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:36.309225 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Pushing event updated for resources: {'Port': ['ID=2a366b9c-cef1-4539-9117-1fabfce12f8d,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:36.313560 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:36.314375 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:36.344199 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:33Z', 'revision_number': 3, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:36.374792 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-055daa24-fd28-43cb-9f6d-c83d376ef100 None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:33Z', 'revision_number': 3, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:49:36.456236 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Network 0a3b5429-9434-492a-ba57-3dfc671d164c is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:49:36.457700 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:36.744631 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-3a271c27-dfb8-4165-865d-7ad065a46df2 None None] Provisioning complete for port 2a366b9c-cef1-4539-9117-1fabfce12f8d triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:36.745141 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3a271c27-dfb8-4165-865d-7ad065a46df2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:36.777753 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Router 39443462-555c-4ab6-8ab8-12514f6596b8 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:49:36.844508 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-3a271c27-dfb8-4165-865d-7ad065a46df2 None None] Port 2a366b9c-cef1-4539-9117-1fabfce12f8d cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:49:36.872034 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5774d267-f664-4bb2-9055-70cd59ebc1dc req-e799335a-31ab-4b19-8c7a-c3458b87f596 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:36.873770 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5774d267-f664-4bb2-9055-70cd59ebc1dc req-e799335a-31ab-4b19-8c7a-c3458b87f596 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1240654 May 26 14:49:36.925610 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5774d267-f664-4bb2-9055-70cd59ebc1dc req-6b464878-91f3-455f-a053-e149d043cd7b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456312 May 26 14:49:36.985441 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:49:36.996306 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] 10.222.0.72 "PUT /v2.0/routers/39443462-555c-4ab6-8ab8-12514f6596b8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6740868 May 26 14:49:37.404186 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:49:37.525591 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46684) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:37.531751 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-909364918-network', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:37.536969 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:37.541761 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Usage tracker for resource:network and tenant:33d94aeb09de4d84a66010b7eea38bd5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:37.545328 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:37.551421 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:37.569088 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Made reservation on behalf of 33d94aeb09de4d84a66010b7eea38bd5 for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:49:37.571783 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.585680 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.598071 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:37.604428 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:37.608652 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Usage tracker for resource:security_group_rule and tenant:33d94aeb09de4d84a66010b7eea38bd5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:37.614489 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:37.615593 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '210e790a-2172-4934-bf39-2d9aecd01a92', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'port_id': '210e790a-2172-4934-bf39-2d9aecd01a92', 'mac_address': 'fa:16:3e:3b:ad:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:49:37.621302 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:37.682032 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.700242 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 210e790a-2172-4934-bf39-2d9aecd01a92 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:49:37.717344 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:37.717545 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.722255 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.723577 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.724116 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:37.726809 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a2b53cd9-6d27-4828-a8c0-0d95f80dcb6d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:37.758209 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1146} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:49:37.763741 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e9ef5fb-3eca-4b02-867c-2a51b71294f6,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:37.767596 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:37.771645 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.771858 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Added segment 786a8ec1-60bd-4f4e-b068-39f29884fb0e of type vlan for network 2f2b3312-ac79-425a-9a67-643b775d13ba May 26 14:49:37.799689 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=6']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:37.801005 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.802944 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:37.838809 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.840496 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:37.841069 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:37.844718 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-60d323de-ab58-425b-9b9d-21fdc3615fc1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:37.866855 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['210e790a-2172-4934-bf39-2d9aecd01a92'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:49:37.948850 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Pushing event updated for resources: {'Network': ['ID=2f2b3312-ac79-425a-9a67-643b775d13ba,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:37.952387 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4256394 May 26 14:49:37.953915 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:37.957011 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46700) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:37.966690 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Request body: {'subnet': {'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-909364918-subnet', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:37.973503 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 2f2b3312-ac79-425a-9a67-643b775d13ba details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:49:37.974823 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:37.979252 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Usage tracker for resource:subnet and tenant:33d94aeb09de4d84a66010b7eea38bd5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:37.982223 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:37.989417 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:38.007353 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Made reservation on behalf of 33d94aeb09de4d84a66010b7eea38bd5 for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:49:38.013230 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2577413'] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.143819 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:49:38.174403 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:38.175151 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:38.176191 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d48a16a1-caa7-4814-bc94-b3d0bb60dff0 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:38.263812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b9cfec-798b-41fa-b9b4-3e0ec2c379ec req-7c76cdd4-e0f1-4199-ba4f-37ddb3e8a2df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:38.265638 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4b9cfec-798b-41fa-b9b4-3e0ec2c379ec req-7c76cdd4-e0f1-4199-ba4f-37ddb3e8a2df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 944 time: 0.1270602 May 26 14:49:38.304707 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port d48a16a1-caa7-4814-bc94-b3d0bb60dff0 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:38.310475 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d48a16a1-caa7-4814-bc94-b3d0bb60dff0 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:38.310939 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.366228 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a4b9cfec-798b-41fa-b9b4-3e0ec2c379ec req-65dda482-07a3-44d2-b914-aa6cad1363f6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0921888 May 26 14:49:38.405868 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:38.482018 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.503104 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port d48a16a1-caa7-4814-bc94-b3d0bb60dff0, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d48a16a1-caa7-4814-bc94-b3d0bb60dff0,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:38.509460 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.511522 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:38.589103 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=d48a16a1-caa7-4814-bc94-b3d0bb60dff0,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:38.599086 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:38.656984 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2332857', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2577427'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.661183 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:38.721016 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Pushing event updated for resources: {'Subnet': ['ID=1453c895-ac82-418c-b052-3278289fec92,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:38.724129 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:38.755820 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Checking segment: {'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:49:38.756107 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Network hostable DHCP agents. Network: 2f2b3312-ac79-425a-9a67-643b775d13ba, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:49:38.776423 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Network 2f2b3312-ac79-425a-9a67-643b775d13ba is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:49:38.791001 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 2f2b3312-ac79-425a-9a67-643b775d13ba) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:38.799603 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-820cfdee-7a45-494a-bf0c-6ff00a7d1b33 None None] Network 2f2b3312-ac79-425a-9a67-643b775d13ba requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:49:38.813676 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:38.816853 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.829211 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:36Z', 'revision_number': 2, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:38.840125 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:49:38.841305 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Updating router 39443462-555c-4ab6-8ab8-12514f6596b8 port 2a366b9c-cef1-4539-9117-1fabfce12f8d binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:49:38.851078 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-48c951c7-c96b-4f26-ab16-a92cd36fc6db admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8921785 May 26 14:49:38.854137 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46724) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:38.859850 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:38.867377 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:38.876979 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Usage tracker for resource:router and tenant:33d94aeb09de4d84a66010b7eea38bd5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:38.883646 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:38.897826 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:38.914896 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.916654 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.917675 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:38.945391 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.105444 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-2f2b3312-ac79-425a-9a67-643b775d13ba', 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'fixed_ips': [{'subnet_id': '1453c895-ac82-418c-b052-3278289fec92'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:49:39.106643 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.279583 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Allocated IP 172.20.0.2 (2f2b3312-ac79-425a-9a67-643b775d13ba/1453c895-ac82-418c-b052-3278289fec92/a181c14c-3176-4bdf-a575-c37a1e3de6db) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:49:39.375258 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.413377 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:39.473739 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.489113 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Transition to ACTIVE for port object 2a366b9c-cef1-4539-9117-1fabfce12f8d will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:39.504152 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.512453 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-c7c481b1-c3f1-44d2-a06e-329a66a0ef33 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:39.542524 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 210e790a-2172-4934-bf39-2d9aecd01a92 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:39.543149 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.623909 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Pushing event updated for resources: {'Port': ['ID=2a366b9c-cef1-4539-9117-1fabfce12f8d,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:39.633791 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.634379 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.634867 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.635329 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.635792 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.636326 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.637222 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.637825 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.638338 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.638798 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.639426 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.640001 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:39.655377 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:39.695553 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f8d93d-f28d-438b-bb16-4482e87e8b61 req-f36faded-0e83-41da-8f47-e94d89a67e54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:39.703764 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-34f8d93d-f28d-438b-bb16-4482e87e8b61 req-f36faded-0e83-41da-8f47-e94d89a67e54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 944 time: 0.1108809 May 26 14:49:39.772505 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-34f8d93d-f28d-438b-bb16-4482e87e8b61 req-66c33549-ab4e-49e4-8677-6272d78ebf97 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0677514 May 26 14:49:39.844665 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.852177 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.909982 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.916452 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Attempting to bind port 2a366b9c-cef1-4539-9117-1fabfce12f8d on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:49:39.916817 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Attempting to bind port 2a366b9c-cef1-4539-9117-1fabfce12f8d by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:49:39.917173 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Attempting to bind port 2a366b9c-cef1-4539-9117-1fabfce12f8d on network 0a3b5429-9434-492a-ba57-3dfc671d164c {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:49:39.923822 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.924604 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 49, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:49:39.924987 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Checking segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:49:39.925676 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.925931 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Bound using segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:49:39.926438 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Bound port: 2a366b9c-cef1-4539-9117-1fabfce12f8d, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:49:39.926814 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:39.944793 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Transition to ACTIVE for port object a181c14c-3176-4bdf-a575-c37a1e3de6db will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:39.996446 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:49:40.004549 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Transition to ACTIVE for port object a181c14c-3176-4bdf-a575-c37a1e3de6db will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:40.022071 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:40.024525 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.029222 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:40.068186 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] For port 2a366b9c-cef1-4539-9117-1fabfce12f8d, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:49:40.081740 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] For port 2a366b9c-cef1-4539-9117-1fabfce12f8d, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=2a366b9c-cef1-4539-9117-1fabfce12f8d,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:49:40.095109 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.105928 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.108241 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92', 'code': 200} May 26 14:49:40.118367 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:40.120196 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Network 2f2b3312-ac79-425a-9a67-643b775d13ba is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:49:40.123851 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:40.130706 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:49:40.165385 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Allocated IP 172.27.3.236 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/938c4ccb-8161-4ac5-914d-f09e83eca319) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:49:40.188935 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:40.190006 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:40.214959 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d48a16a1-caa7-4814-bc94-b3d0bb60dff0 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:40.270168 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Pushing event updated for resources: {'Port': ['ID=a181c14c-3176-4bdf-a575-c37a1e3de6db,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:40.328850 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:40.350718 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-02cbd19e-56d0-409c-aba5-026a623d8c1d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.243s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:40.464079 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:40.527754 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=7']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:40.541422 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:40.557647 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Attempting to bind port a181c14c-3176-4bdf-a575-c37a1e3de6db on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:49:40.558952 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Attempting to bind port a181c14c-3176-4bdf-a575-c37a1e3de6db by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:49:40.559558 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Attempting to bind port a181c14c-3176-4bdf-a575-c37a1e3de6db on network 2f2b3312-ac79-425a-9a67-643b775d13ba {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:49:40.570191 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 49, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:49:40.571085 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Checking segment: {'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:49:40.571907 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.572462 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Bound using segment: {'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:49:40.573104 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Bound port: a181c14c-3176-4bdf-a575-c37a1e3de6db, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:49:40.573729 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.577413 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.619457 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.626021 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:40.652056 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port d48a16a1-caa7-4814-bc94-b3d0bb60dff0 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:40.652691 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.692323 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:49:40.701844 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:40.713436 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Pushing event updated for resources: {'Port': ['ID=2a366b9c-cef1-4539-9117-1fabfce12f8d,revision_number=4']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:40.718064 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:49:40.723753 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.605s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:40.751953 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] For port a181c14c-3176-4bdf-a575-c37a1e3de6db, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:49:40.759192 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] For port a181c14c-3176-4bdf-a575-c37a1e3de6db, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a181c14c-3176-4bdf-a575-c37a1e3de6db,segment=NetworkSegment(786a8ec1-60bd-4f4e-b068-39f29884fb0e),segment_id=786a8ec1-60bd-4f4e-b068-39f29884fb0e)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:49:40.793191 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:40.804593 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:40.809471 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Pushing event updated for resources: {'Port': ['ID=938c4ccb-8161-4ac5-914d-f09e83eca319,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:40.818579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:40.938167 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:40Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:40.942947 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Pushing event updated for resources: {'Port': ['ID=a181c14c-3176-4bdf-a575-c37a1e3de6db,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:40.947287 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:40.953792 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e2ead2b-9223-4268-a9bb-19429857ec57 None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:40Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:49:41.103251 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75ea719-947f-4f69-a600-713fe706bac7 req-4044b14a-ea74-4fdb-8069-ebf6796da6ea tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:41.111097 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c75ea719-947f-4f69-a600-713fe706bac7 req-4044b14a-ea74-4fdb-8069-ebf6796da6ea tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1658862 May 26 14:49:41.203792 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c75ea719-947f-4f69-a600-713fe706bac7 req-3c1d66fe-7edf-424f-8d31-342ee5313156 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0784824 May 26 14:49:41.440501 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:41.957086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:42.160535 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fffe4172-3cf2-467c-a52e-b7d8c864471d None None] Network 2f2b3312-ac79-425a-9a67-643b775d13ba requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:49:42.315200 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 2a366b9c-cef1-4539-9117-1fabfce12f8d up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:42.325526 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98444) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:49:42.414617 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-e7ba6f2d-f549-450a-849c-70532d8b7844 None None] Provisioning for port a181c14c-3176-4bdf-a575-c37a1e3de6db completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:42.447055 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 2a366b9c-cef1-4539-9117-1fabfce12f8d completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:42.464486 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 2a366b9c-cef1-4539-9117-1fabfce12f8d triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:42.464486 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:42.529678 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a14bff-262d-4b2c-ae9a-2a3a4ea2c9b3 req-fa6fc21c-5351-4e18-85bc-7c8c3fe4a7df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:42.538016 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f9a14bff-262d-4b2c-ae9a-2a3a4ea2c9b3 req-fa6fc21c-5351-4e18-85bc-7c8c3fe4a7df tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1108057 May 26 14:49:42.592347 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f9a14bff-262d-4b2c-ae9a-2a3a4ea2c9b3 req-6cc19fed-a417-457d-b7e6-5ca7c0f08021 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0525193 May 26 14:49:42.599196 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:49:42.623273 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Sync routers for ids ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:49:42.633605 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:42.635794 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 3.7801573 May 26 14:49:42.638558 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46742) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:42.655889 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Routers {'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:42.656576 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:42.981759 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:43.010477 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Set router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:43.261979 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 2a366b9c-cef1-4539-9117-1fabfce12f8d, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=2a366b9c-cef1-4539-9117-1fabfce12f8d,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:43.284358 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:43.286361 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a181c14c-3176-4bdf-a575-c37a1e3de6db up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:43.343960 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-cf08b395-b4b7-40ba-9615-4b329d237d3c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:43.595092 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=2a366b9c-cef1-4539-9117-1fabfce12f8d,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:43.599961 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:43.656749 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port a181c14c-3176-4bdf-a575-c37a1e3de6db completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:43.675704 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port a181c14c-3176-4bdf-a575-c37a1e3de6db triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:43.676436 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:43.741865 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236'}], 'enable_snat': True}, 'gw_port_id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:49:41Z', 'revision_number': 3, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port': {'id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:19:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:39Z', 'updated_at': '2021-05-26T14:49:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:43.750372 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Checking router: dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:49:43.751044 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Updating router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 port 938c4ccb-8161-4ac5-914d-f09e83eca319 binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:49:43.850816 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:43.936452 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:43.951656 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.057088 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c64360-867a-4ab6-ad1e-0b119eff9397 req-4ebd0ab5-84ce-4c3c-bd7f-15259ca6f7a8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:44.072982 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-33c64360-867a-4ab6-ad1e-0b119eff9397 req-4ebd0ab5-84ce-4c3c-bd7f-15259ca6f7a8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.2328441 May 26 14:49:44.222453 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-33c64360-867a-4ab6-ad1e-0b119eff9397 req-e5e5ce1d-6ab7-4831-a44c-eaaf927ba33c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1021059 May 26 14:49:44.247590 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port a181c14c-3176-4bdf-a575-c37a1e3de6db, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a181c14c-3176-4bdf-a575-c37a1e3de6db,segment=NetworkSegment(786a8ec1-60bd-4f4e-b068-39f29884fb0e),segment_id=786a8ec1-60bd-4f4e-b068-39f29884fb0e)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:44.262120 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.267212 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:44.290382 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Allocated IP 172.20.0.1 (2f2b3312-ac79-425a-9a67-643b775d13ba/1453c895-ac82-418c-b052-3278289fec92/917afd6f-9580-4821-871f-5de127fbbd50) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:49:44.382504 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=a181c14c-3176-4bdf-a575-c37a1e3de6db,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:44.386141 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:44.448890 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 2a366b9c-cef1-4539-9117-1fabfce12f8d up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:44.515355 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.534493 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.537407 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Transition to ACTIVE for port object 917afd6f-9580-4821-871f-5de127fbbd50 will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:44.557389 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Transition to ACTIVE for port object 938c4ccb-8161-4ac5-914d-f09e83eca319 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:44.573738 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.579922 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.580713 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:44.594101 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-634694ce-9894-449c-af45-08d6dc517e27 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:44.662389 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 2a366b9c-cef1-4539-9117-1fabfce12f8d triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:44.662771 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.666898 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Network 2f2b3312-ac79-425a-9a67-643b775d13ba is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:49:44.671206 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:44.675463 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:49:44.724890 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Attempting to bind port 938c4ccb-8161-4ac5-914d-f09e83eca319 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:49:44.725346 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Attempting to bind port 938c4ccb-8161-4ac5-914d-f09e83eca319 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:49:44.725843 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Attempting to bind port 938c4ccb-8161-4ac5-914d-f09e83eca319 on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:49:44.739773 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 49, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:49:44.740417 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:49:44.740946 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.741426 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:49:44.742342 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Bound port: 938c4ccb-8161-4ac5-914d-f09e83eca319, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:49:44.742497 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.742653 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Pushing event updated for resources: {'Port': ['ID=917afd6f-9580-4821-871f-5de127fbbd50,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:44.753664 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:44.763271 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.777082 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acee3ea-c005-4b6c-893f-a600ea47403e None None] Pushing event updated for resources: {'Port': ['ID=938c4ccb-8161-4ac5-914d-f09e83eca319,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:44.799314 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-7acee3ea-c005-4b6c-893f-a600ea47403e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:44.923153 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.933109 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] For port 938c4ccb-8161-4ac5-914d-f09e83eca319, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:49:44.950228 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] For port 938c4ccb-8161-4ac5-914d-f09e83eca319, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=938c4ccb-8161-4ac5-914d-f09e83eca319,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:49:44.961736 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:44.966219 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:45.047352 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Routers {'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:45.048156 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:45.106385 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acee3ea-c005-4b6c-893f-a600ea47403e None None] Pushing event updated for resources: {'Port': ['ID=938c4ccb-8161-4ac5-914d-f09e83eca319,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:45.118480 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-7acee3ea-c005-4b6c-893f-a600ea47403e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:45.132336 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-09eeea9a-0a59-4504-8136-442b3072b5f7 None None] Provisioning for port 917afd6f-9580-4821-871f-5de127fbbd50 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:45.143114 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-09eeea9a-0a59-4504-8136-442b3072b5f7 None None] Provisioning complete for port 917afd6f-9580-4821-871f-5de127fbbd50 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:45.143617 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-09eeea9a-0a59-4504-8136-442b3072b5f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:45.345512 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-09eeea9a-0a59-4504-8136-442b3072b5f7 None None] Port 917afd6f-9580-4821-871f-5de127fbbd50 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:49:45.394003 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] Set router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:45.448118 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:45.459304 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:45.492536 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-73f83978-f291-4392-bae6-a33694f32678 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:45.541749 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27521d93-14e7-4a19-b729-7222c2fd49a7 req-0f0bc347-5890-4ba9-b38c-0db344d30194 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:45.548927 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-27521d93-14e7-4a19-b729-7222c2fd49a7 req-0f0bc347-5890-4ba9-b38c-0db344d30194 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1279914 May 26 14:49:45.632263 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:45.644361 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Pushing event updated for resources: {'Port': ['ID=917afd6f-9580-4821-871f-5de127fbbd50,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:45.656621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:45.680769 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-27521d93-14e7-4a19-b729-7222c2fd49a7 req-e3aa3dae-2590-4d48-a7f8-882930377475 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1252303 May 26 14:49:45.820334 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Network 2f2b3312-ac79-425a-9a67-643b775d13ba is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:49:45.821634 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:49:45.926784 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236'}], 'enable_snat': True}, 'gw_port_id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 4, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port': {'id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:19:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:39Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '917afd6f-9580-4821-871f-5de127fbbd50', 'name': '', 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'mac_address': 'fa:16:3e:07:de:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '1453c895-ac82-418c-b052-3278289fec92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:44Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 1, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'subnets': [{'id': '1453c895-ac82-418c-b052-3278289fec92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:45.932000 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0ea9ce4-c6ab-45e3-a34d-4b7c691a8d2c None None] The sync data for ids ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'] in dv-cinder-774594-6-iscsi is: [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236'}], 'enable_snat': True}, 'gw_port_id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 4, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port': {'id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:19:52:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:39Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '917afd6f-9580-4821-871f-5de127fbbd50', 'name': '', 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'mac_address': 'fa:16:3e:07:de:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '1453c895-ac82-418c-b052-3278289fec92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:44Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 1, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'subnets': [{'id': '1453c895-ac82-418c-b052-3278289fec92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:49:46.187281 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-e7684d2a-2fc0-4ed2-ae6b-048149f4cd2c None None] Provisioning complete for port 917afd6f-9580-4821-871f-5de127fbbd50 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:46.188519 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e7684d2a-2fc0-4ed2-ae6b-048149f4cd2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:46.190388 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:49:46.229292 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:49:46.358556 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-e7684d2a-2fc0-4ed2-ae6b-048149f4cd2c None None] Port 917afd6f-9580-4821-871f-5de127fbbd50 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:49:46.473395 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a181c14c-3176-4bdf-a575-c37a1e3de6db up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:46.575003 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port a181c14c-3176-4bdf-a575-c37a1e3de6db triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:46.576837 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:49:46.577649 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:46.603872 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] 10.222.0.72 "PUT /v2.0/routers/dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9639950 May 26 14:49:46.932275 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-702d2a90-b385-4e86-8b47-22f88dd8ed8f req-45558567-5ce3-4690-aba1-ecc6088db536 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:46.940104 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-702d2a90-b385-4e86-8b47-22f88dd8ed8f req-45558567-5ce3-4690-aba1-ecc6088db536 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0927463 May 26 14:49:47.000567 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-702d2a90-b385-4e86-8b47-22f88dd8ed8f req-e1832606-cda4-4276-b484-03c2f644b446 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0538254 May 26 14:49:47.204616 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46790) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:47.210829 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1100445324', 'description': 'tempest-secgroup-smoke-1100445324 description', 'project_id': '054087186333487b82b9a7a12d02c80f'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:47.219641 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:47.227286 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:security_group and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:47.233798 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:47.242079 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:47.254735 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:47.297665 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:47.303264 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:security_group_rule and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:47.307207 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:47.319825 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:47.411299 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:47.417034 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:47.426419 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9b46d1ba-c79e-42b5-a7cf-e61b6186a7e5 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:47.473022 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ccbc02f3-8afe-463e-99ee-7fa02c671594,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:47.477000 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:47.485021 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:47.486320 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.2805915 May 26 14:49:47.489495 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46798) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:47.495263 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'security_group_rule': {'security_group_id': 'ccbc02f3-8afe-463e-99ee-7fa02c671594', 'project_id': '054087186333487b82b9a7a12d02c80f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:47.531416 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:47.536217 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:security_group_rule and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:47.539650 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:47.548264 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:47.576056 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:47.705369 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:47.711931 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:47.714594 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:47.874591 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=96f4c78c-0c03-49df-b5b6-a86952e5317f,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:47.884487 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:47.911269 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:47.912990 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4221759 May 26 14:49:47.915862 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46808) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:47.923707 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'security_group_rule': {'security_group_id': 'ccbc02f3-8afe-463e-99ee-7fa02c671594', 'project_id': '054087186333487b82b9a7a12d02c80f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:47.932057 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:47.939094 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:security_group_rule and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:47.943411 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:47.956852 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:47.992007 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.134703 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.144479 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.146759 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-860828bf-26e7-42f9-9c6c-4c0e5a635ba6 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:48.237533 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5b403cdd-c28f-4d5a-a206-696b774b616f,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:48.248854 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:48.259459 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.262356 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-d3e55c77-2557-4bf0-9db6-dbe8af048f1c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3435533 May 26 14:49:48.263441 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46816) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:48.269587 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'security_group_rule': {'security_group_id': 'ccbc02f3-8afe-463e-99ee-7fa02c671594', 'project_id': '054087186333487b82b9a7a12d02c80f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:48.275790 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:48.279882 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:security_group_rule and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:48.283976 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:48.296455 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:48.368966 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.449812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89c5f8da-6ebd-4923-ab18-79d32a9a020c req-bdca8462-b57d-41c7-9fc1-4008d7229ff5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:48.452855 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-89c5f8da-6ebd-4923-ab18-79d32a9a020c req-bdca8462-b57d-41c7-9fc1-4008d7229ff5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.2578511 May 26 14:49:48.461465 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 938c4ccb-8161-4ac5-914d-f09e83eca319 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:48.560640 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 938c4ccb-8161-4ac5-914d-f09e83eca319 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:48.571240 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 938c4ccb-8161-4ac5-914d-f09e83eca319 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:48.572263 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.593762 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-89c5f8da-6ebd-4923-ab18-79d32a9a020c req-d73b895d-d310-443d-8df7-491d36551052 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1322520 May 26 14:49:48.599392 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.608282 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.617567 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6ca315f3-5221-488a-9e99-ed7a9473faeb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:48.655699 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4822eae1-8c4f-4930-b9d9-dadfb05ad562 req-bac35ef7-5817-4cae-8b9d-9ff3ba3fb65a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:48.661233 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4822eae1-8c4f-4930-b9d9-dadfb05ad562 req-bac35ef7-5817-4cae-8b9d-9ff3ba3fb65a tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 946 time: 0.1973441 May 26 14:49:48.667796 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98a03ac3-f2cd-44c9-96f7-8399c5d700ad,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:48.673984 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.675469 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4111037 May 26 14:49:48.678427 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46822) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:48.684170 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'security_group_rule': {'security_group_id': 'ccbc02f3-8afe-463e-99ee-7fa02c671594', 'project_id': '054087186333487b82b9a7a12d02c80f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:48.691228 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:48.696223 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:security_group_rule and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:48.698520 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.698967 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.699564 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.699989 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.700560 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.700989 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:48.701654 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.702203 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.702939 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.703489 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.704029 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.704556 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.705097 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:49:48.708978 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:48.712543 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:48.734262 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.741774 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4822eae1-8c4f-4930-b9d9-dadfb05ad562 req-1365c513-d05d-475c-92cb-86a2d428d1b4 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710537 May 26 14:49:48.789450 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.810233 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 938c4ccb-8161-4ac5-914d-f09e83eca319, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=938c4ccb-8161-4ac5-914d-f09e83eca319,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:48.813523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.815262 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.817187 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:48.818924 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.845837 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fc5fa918-3dcf-4dcb-bae0-0df42f540487 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:48.858150 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:48.863119 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46830) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:48.870898 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'security_group_rule': {'security_group_id': 'ccbc02f3-8afe-463e-99ee-7fa02c671594', 'project_id': '054087186333487b82b9a7a12d02c80f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:48.876321 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1962419 May 26 14:49:48.884816 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:48.890650 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aa221449-b44c-4659-aeed-eaad5c06b753,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:48.896994 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:security_group_rule and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:48.898291 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7e85be1e-6da5-4489-997f-486ba7484211 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:48.902474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:48.905616 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=938c4ccb-8161-4ac5-914d-f09e83eca319,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:48.910935 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:48.915920 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:48.925465 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.securitygroups_db [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Project 054087186333487b82b9a7a12d02c80f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 26 14:49:48.932565 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:49.002937 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:49.009065 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:49.012148 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:49.035572 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d8f652b1-7661-48e7-80d8-eff990d787ed,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:49.038406 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:49.050441 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:49.054187 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3a18aefb-1542-4fdb-a581-2f6bfdf16c0c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1873076 May 26 14:49:49.054552 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46834) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:49.063931 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'security_group_rule': {'security_group_id': 'ccbc02f3-8afe-463e-99ee-7fa02c671594', 'project_id': '054087186333487b82b9a7a12d02c80f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:49:49.070044 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:49:49.074860 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:security_group_rule and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:49:49.079008 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:49:49.085980 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:49:49.097030 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.securitygroups_db [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Project 054087186333487b82b9a7a12d02c80f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 26 14:49:49.110968 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:49.196185 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:49.201438 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:49.204937 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-36c146f7-ba33-47f9-aeb3-c79820332a1d tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:49.223903 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3281752b-0472-4ced-bde9-d5396e75f13b,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:49.226640 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:49.246736 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:49.248829 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0d5cde90-161c-4a06-a2ed-d73bd22e0a02 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1929741 May 26 14:49:49.561936 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Sync routers for ids ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:49:49.579186 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Routers {'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:49.581740 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:49.868289 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Set router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:49.916016 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ac6565-43c3-4fea-807f-6164498f487a req-8d2e4158-7c1e-4d57-ab70-ad8a53bc6907 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:49.935765 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-05ac6565-43c3-4fea-807f-6164498f487a req-8d2e4158-7c1e-4d57-ab70-ad8a53bc6907 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1882915 May 26 14:49:50.054637 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-05ac6565-43c3-4fea-807f-6164498f487a req-d0af4b2b-56f3-46b0-8394-6a383093b000 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1174862 May 26 14:49:50.117743 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bebd603-ad54-4815-a518-c179b8682724 req-836db5bd-0980-418f-b79d-26636db86997 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:50.119488 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6bebd603-ad54-4815-a518-c179b8682724 req-836db5bd-0980-418f-b79d-26636db86997 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 946 time: 0.1495697 May 26 14:49:50.185479 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6bebd603-ad54-4815-a518-c179b8682724 req-2c255faa-6c6d-4741-8243-5f9011384a75 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595970 May 26 14:49:50.290449 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236'}], 'enable_snat': True}, 'gw_port_id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 4, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port': {'id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:19:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:39Z', 'updated_at': '2021-05-26T14:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '917afd6f-9580-4821-871f-5de127fbbd50', 'name': '', 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'mac_address': 'fa:16:3e:07:de:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '1453c895-ac82-418c-b052-3278289fec92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:44Z', 'updated_at': '2021-05-26T14:49:45Z', 'revision_number': 2, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'subnets': [{'id': '1453c895-ac82-418c-b052-3278289fec92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:50.295254 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Checking router: dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:49:50.295569 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Updating router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 port 917afd6f-9580-4821-871f-5de127fbbd50 binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:49:50.313471 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec98efaf-8454-4777-80d3-124531796d1c req-8f9ee779-55d1-44f1-927b-aa7df8453615 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:50.314921 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-ec98efaf-8454-4777-80d3-124531796d1c req-8f9ee779-55d1-44f1-927b-aa7df8453615 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Synchronizing usage tracker for tenant:c906c656a3474e64ab918724c042f2be on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:49:50.346970 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-ec98efaf-8454-4777-80d3-124531796d1c req-8f9ee779-55d1-44f1-927b-aa7df8453615 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Unset dirty status for tenant:c906c656a3474e64ab918724c042f2be on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:49:50.348405 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-ec98efaf-8454-4777-80d3-124531796d1c req-8f9ee779-55d1-44f1-927b-aa7df8453615 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 946 time: 0.1473584 May 26 14:49:50.352109 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 938c4ccb-8161-4ac5-914d-f09e83eca319 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:50.369019 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:50.461051 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 938c4ccb-8161-4ac5-914d-f09e83eca319 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:50.461423 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:50.570586 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Deleting port cd553d24-bf3e-45c7-903e-b5459cf05099 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:49:50.571168 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:50.733144 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] For port cd553d24-bf3e-45c7-903e-b5459cf05099, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=cd553d24-bf3e-45c7-903e-b5459cf05099,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:50.735890 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:50.873264 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:50.918078 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Transition to ACTIVE for port object 917afd6f-9580-4821-871f-5de127fbbd50 will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:49:50.934952 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:50.956156 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-a408d766-8837-4675-a6ad-66391dc2c0ac None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:51.142651 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bca45ed6-e8f6-4626-bd29-12f40d80f193 None None] Pushing event updated for resources: {'Port': ['ID=917afd6f-9580-4821-871f-5de127fbbd50,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:51.153140 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-bca45ed6-e8f6-4626-bd29-12f40d80f193 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:51.263497 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Attempting to bind port 917afd6f-9580-4821-871f-5de127fbbd50 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:49:51.263867 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Attempting to bind port 917afd6f-9580-4821-871f-5de127fbbd50 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:49:51.264222 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Attempting to bind port 917afd6f-9580-4821-871f-5de127fbbd50 on network 2f2b3312-ac79-425a-9a67-643b775d13ba {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:49:51.289788 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 49, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:49:51.290174 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Checking segment: {'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:49:51.290597 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:51.290983 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Bound using segment: {'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:49:51.291456 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Bound port: 917afd6f-9580-4821-871f-5de127fbbd50, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '786a8ec1-60bd-4f4e-b068-39f29884fb0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1146, 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:49:51.291820 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:51.308746 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:51.309062 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:51.309344 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Floating IP 2385c9dd-c299-4860-8523-d1b1d53341c4 disassociated. External IP: 172.27.3.156, port: cd553d24-bf3e-45c7-903e-b5459cf05099. May 26 14:49:51.309677 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Calling delete_port for cd553d24-bf3e-45c7-903e-b5459cf05099 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:49:51.425619 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-374e249e-5b88-46c3-adf7-38bac796ad49 req-6dc72e3b-b1fb-4d46-b98f-d8b19a2140ca tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:51.436995 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-374e249e-5b88-46c3-adf7-38bac796ad49 req-6dc72e3b-b1fb-4d46-b98f-d8b19a2140ca tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1328237 May 26 14:49:51.488774 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] For port 917afd6f-9580-4821-871f-5de127fbbd50, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:49:51.493252 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] For port 917afd6f-9580-4821-871f-5de127fbbd50, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=917afd6f-9580-4821-871f-5de127fbbd50,segment=NetworkSegment(786a8ec1-60bd-4f4e-b068-39f29884fb0e),segment_id=786a8ec1-60bd-4f4e-b068-39f29884fb0e)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:49:51.501671 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:51.515391 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:51.527216 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:51.534966 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-48855e21-d68d-4fb4-a96f-6e80229a8077 tempest-ServerRescueNegativeTestJSON-157050899 tempest-ServerRescueNegativeTestJSON-157050899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:51.555420 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-374e249e-5b88-46c3-adf7-38bac796ad49 req-1e81f039-9a8d-4a17-b719-73b112944415 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0720623 May 26 14:49:51.577966 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020fb5b1-58b6-428e-b517-a6f1662f416d req-8c2119f7-04e1-4a05-bb33-68b808e2e878 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:51.584440 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-020fb5b1-58b6-428e-b517-a6f1662f416d req-8c2119f7-04e1-4a05-bb33-68b808e2e878 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 946 time: 0.1484454 May 26 14:49:51.604129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event deleted for resources: {'Port': ['ID=cd553d24-bf3e-45c7-903e-b5459cf05099,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:51.614419 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:51.679255 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b6e6b650-5e5d-4d1a-abda-dce7721525b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:51.698698 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-020fb5b1-58b6-428e-b517-a6f1662f416d req-1acbb604-11ea-4089-b4d7-2390683101e7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups?id=f9197882-88a8-47ad-8b3b-7218a705f568&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1079645 May 26 14:49:51.728324 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Routers {'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:51.728981 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:51.812581 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bca45ed6-e8f6-4626-bd29-12f40d80f193 None None] Pushing event updated for resources: {'Port': ['ID=917afd6f-9580-4821-871f-5de127fbbd50,revision_number=4']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:51.825581 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-bca45ed6-e8f6-4626-bd29-12f40d80f193 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.310s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:51.921621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Router 3865f36a-0ff1-4ceb-997f-e7f4306675ef has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:49:52.041435 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] Set router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:52.174063 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:49:52.186863 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] Sync routers for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:49:52.209490 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:52.210076 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:52.285286 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] No DVR routers for this DVR port cd553d24-bf3e-45c7-903e-b5459cf05099 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:49:52.287826 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:52.293098 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'name': 'network-vif-deleted', 'tag': 'cd553d24-bf3e-45c7-903e-b5459cf05099'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:49:52.340753 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-ec98efaf-8454-4777-80d3-124531796d1c req-607d9813-797e-4722-bc95-efa4e92e96b1 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.79 "DELETE /v2.0/ports/cd553d24-bf3e-45c7-903e-b5459cf05099 HTTP/1.1" status: 204 len: 173 time: 1.9848018 May 26 14:49:52.444592 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9aca7c45-6a93-4c3e-bfea-f4b4520873c0', 'name': 'network-vif-deleted', 'tag': 'cd553d24-bf3e-45c7-903e-b5459cf05099', 'status': 'completed', 'code': 200} May 26 14:49:52.518734 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236'}], 'enable_snat': True}, 'gw_port_id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 4, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port': {'id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:19:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:39Z', 'updated_at': '2021-05-26T14:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '917afd6f-9580-4821-871f-5de127fbbd50', 'name': '', 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'mac_address': 'fa:16:3e:07:de:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '1453c895-ac82-418c-b052-3278289fec92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:44Z', 'updated_at': '2021-05-26T14:49:51Z', 'revision_number': 4, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'subnets': [{'id': '1453c895-ac82-418c-b052-3278289fec92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:52.523249 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-891eead2-89ef-45ff-bd14-ad32b5231196 None None] The sync data for ids ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'] in dv-cinder-774594-6-iscsi is: [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236'}], 'enable_snat': True}, 'gw_port_id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:49:44Z', 'revision_number': 4, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port': {'id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:19:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:39Z', 'updated_at': '2021-05-26T14:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '917afd6f-9580-4821-871f-5de127fbbd50', 'name': '', 'network_id': '2f2b3312-ac79-425a-9a67-643b775d13ba', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'mac_address': 'fa:16:3e:07:de:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '1453c895-ac82-418c-b052-3278289fec92', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:44Z', 'updated_at': '2021-05-26T14:49:51Z', 'revision_number': 4, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'subnets': [{'id': '1453c895-ac82-418c-b052-3278289fec92', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:49:52.533290 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 917afd6f-9580-4821-871f-5de127fbbd50 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:52.674519 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:52.797885 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 917afd6f-9580-4821-871f-5de127fbbd50 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:49:52.895987 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 917afd6f-9580-4821-871f-5de127fbbd50 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:52.896225 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:52.906790 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001a1d85-9c40-40e9-8b67-51e39e0bd0b4 req-87a72587-a239-40d9-b7bc-b5576737d72a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:52.908412 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-001a1d85-9c40-40e9-8b67-51e39e0bd0b4 req-87a72587-a239-40d9-b7bc-b5576737d72a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1428235 May 26 14:49:53.069983 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-001a1d85-9c40-40e9-8b67-51e39e0bd0b4 req-505ef3fc-3f4f-4df9-99b6-38e52cb1eb0f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1096516 May 26 14:49:53.084644 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-62791583-0dee-47ba-82bc-0f7a0b252c56 req-4f7dd9a7-0055-416a-8f9c-bbecfdf0eb96 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/ports?device_id=9aca7c45-6a93-4c3e-bfea-f4b4520873c0 HTTP/1.1" status: 200 len: 210 time: 0.1640179 May 26 14:49:53.320171 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:53.335475 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e3962f63-5e07-45b5-b33e-c98a2b011f74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:53.435606 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 917afd6f-9580-4821-871f-5de127fbbd50, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=917afd6f-9580-4821-871f-5de127fbbd50,segment=NetworkSegment(786a8ec1-60bd-4f4e-b068-39f29884fb0e),segment_id=786a8ec1-60bd-4f4e-b068-39f29884fb0e)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:53.446154 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:53.448309 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device cd553d24-bf3e-45c7-903e-b5459cf05099 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:49:53.477985 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-b555fb30-afcb-4c79-9ef3-61453a465d02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:53.538345 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: cd553d24-bf3e-45c7-903e-b5459cf05099 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:49:53.538345 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device cd553d24-bf3e-45c7-903e-b5459cf05099 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:49:53.569998 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:53.580917 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] Checking router: 3865f36a-0ff1-4ceb-997f-e7f4306675ef for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:49:53.583483 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=917afd6f-9580-4821-871f-5de127fbbd50,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:53.586880 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:53.595812 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:49:53.598479 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:53.822435 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:49:54.218312 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:49:54.223132 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4159cddf-bbd5-477d-a778-fd51eb9d55ff None None] The sync data for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi is: [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:43:06Z', 'revision_number': 4, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '926d9d5c-2945-44cb-898f-bc6ea47b2a43', 'name': '', 'network_id': '82f940d8-9b5b-4a1a-9b79-05f05dbfa116', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'mac_address': 'fa:16:3e:c9:29:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 119, 'fixed_ips': [{'subnet_id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:43:02Z', 'updated_at': '2021-05-26T14:43:18Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'subnets': [{'id': '0ff14072-b6ed-4e7e-acdf-9c02d2a054b3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:49:54.232347 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46926) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:54.312870 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fe6972f6-2509-44db-b4fe-ddd875b27199 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:54.323368 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b719747-849c-446c-a8a8-a2f808ea7458 req-beffea3b-5062-451a-9297-3887e213fc16 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:54.325433 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6b719747-849c-446c-a8a8-a2f808ea7458 req-beffea3b-5062-451a-9297-3887e213fc16 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.1012161 May 26 14:49:54.355648 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fe6972f6-2509-44db-b4fe-ddd875b27199 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:54.377081 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 917afd6f-9580-4821-871f-5de127fbbd50 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:49:54.385838 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6b719747-849c-446c-a8a8-a2f808ea7458 req-4dc4993e-2ba3-401b-b35e-40b9472d45d4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535693 May 26 14:49:54.446771 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fe6972f6-2509-44db-b4fe-ddd875b27199 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:54.453024 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-3413ff24-dc50-461d-bae8-748a73a41692 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:54.468401 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 917afd6f-9580-4821-871f-5de127fbbd50 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:49:54.468782 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:54.473612 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6972f6-2509-44db-b4fe-ddd875b27199 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9197882-88a8-47ad-8b3b-7218a705f568,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:54.479963 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fe6972f6-2509-44db-b4fe-ddd875b27199 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:54.487856 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-fe6972f6-2509-44db-b4fe-ddd875b27199 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:54.490843 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-fe6972f6-2509-44db-b4fe-ddd875b27199 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "DELETE /v2.0/security-groups/f9197882-88a8-47ad-8b3b-7218a705f568 HTTP/1.1" status: 204 len: 168 time: 0.2574208 May 26 14:49:54.491933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 46936) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:54.510717 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.api.v2.resource [None req-85a91a64-49bb-43c9-ad25-66351d72e3c7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] show failed (client error): The resource could not be found. May 26 14:49:54.512058 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-85a91a64-49bb-43c9-ad25-66351d72e3c7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "GET /v2.0/security-groups/f9197882-88a8-47ad-8b3b-7218a705f568 HTTP/1.1" status: 404 len: 347 time: 0.0189714 May 26 14:49:54.515804 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46940) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:49:54.583679 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:54.601618 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65e5b698-d640-4eda-a909-26ff7dca643a None None] New status for floating IP 2385c9dd-c299-4860-8523-d1b1d53341c4: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:49:54.762712 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Deleting port 17a8670a-1595-4038-bb0e-defaf12e2fb3 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:49:54.763154 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:54.891720 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:54.892029 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:55.023305 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Calling delete_port for 17a8670a-1595-4038-bb0e-defaf12e2fb3 owned by network:floatingip {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:49:55.141299 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:55.144958 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-44c3e57f-f92c-4c12-a29a-b73ece3a1901 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:55.313320 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Pushing event deleted for resources: {'Port': ['ID=17a8670a-1595-4038-bb0e-defaf12e2fb3,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:55.322493 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:55.430380 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks [] for floatingip, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:55.443579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-9cd22673-644f-4def-b992-ca2a65116473 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:55.445062 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-9cd22673-644f-4def-b992-ca2a65116473 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1098 time: 0.2717144 May 26 14:49:55.450981 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:55.452406 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] 10.222.0.72 "DELETE /v2.0/floatingips/2385c9dd-c299-4860-8523-d1b1d53341c4 HTTP/1.1" status: 204 len: 168 time: 0.9353447 May 26 14:49:55.595939 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-bc97dfef-38b0-4ae5-b72a-3766a2bf794b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:55.597435 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-bc97dfef-38b0-4ae5-b72a-3766a2bf794b service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1439431 May 26 14:49:55.598164 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f819c82-67a8-471a-ac45-a4e032371b71 req-1355ac71-9a7f-4f91-9777-362e98f9a6de tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:55.599746 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4f819c82-67a8-471a-ac45-a4e032371b71 req-1355ac71-9a7f-4f91-9777-362e98f9a6de tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0923479 May 26 14:49:55.647354 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-4f819c82-67a8-471a-ac45-a4e032371b71 req-220b593d-61fb-478d-abe9-1fd80ea088cb tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414841 May 26 14:49:55.701765 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-841b5724-4c9d-4f18-9b71-b689eb57162f service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 200 len: 1001 time: 0.0973594 May 26 14:49:55.781150 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-abb58692-cf20-4262-a0a7-59c51c85159d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:55.782648 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-abb58692-cf20-4262-a0a7-59c51c85159d service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0725856 May 26 14:49:55.860804 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-0a648354-337c-4394-8d78-e2e45f94d5fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:55.862520 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-0a648354-337c-4394-8d78-e2e45f94d5fe service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0731523 May 26 14:49:55.884415 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:55.909255 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:56.007548 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-2bd03e14-b372-4d36-b4a1-7c8fb045bd89 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1382003 May 26 14:49:56.144121 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-cee402c2-33fd-4bc7-a529-d6236d25a1bd req-636d1700-cc7c-4296-af9c-e48314810d2d service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1287136 May 26 14:49:56.857144 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3740f73-1bf7-46a1-ab76-1cba84c1894b req-09795c59-38db-434f-8c83-aae0071a9e31 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:56.858629 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a3740f73-1bf7-46a1-ab76-1cba84c1894b req-09795c59-38db-434f-8c83-aae0071a9e31 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 945 time: 0.0914106 May 26 14:49:56.907539 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a3740f73-1bf7-46a1-ab76-1cba84c1894b req-6e4ccb26-854d-461f-a6f6-05112784ab10 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426173 May 26 14:49:57.456151 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:49:57.520769 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:57.587063 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:57.587352 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-508517ec-89cc-4070-b007-460a50a50562 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:57.588877 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-508517ec-89cc-4070-b007-460a50a50562 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1098 time: 0.0808334 May 26 14:49:57.619036 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:49:57.628661 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:49:57.633609 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:49:57.635469 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:57.668341 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92', 'code': 200} May 26 14:49:57.712524 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=8']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:49:57.716245 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:57.766748 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-5a411cea-06d3-4e5a-888b-1fba73bb3103 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:57.768188 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-5a411cea-06d3-4e5a-888b-1fba73bb3103 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1362555 May 26 14:49:57.868919 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-ea67e955-8b75-4d22-8b7e-df6f7fedec0a service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 200 len: 999 time: 0.0933840 May 26 14:49:57.943483 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-ebdbd0a0-daaf-49d0-a25e-94165a899f39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:57.945004 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-ebdbd0a0-daaf-49d0-a25e-94165a899f39 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0698359 May 26 14:49:58.070840 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-0690bbad-1f3c-4ea6-99ef-271a72c877f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:58.072196 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-0690bbad-1f3c-4ea6-99ef-271a72c877f1 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1070201 May 26 14:49:58.139432 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd1cad7-621c-4a77-89d4-de4a655e5aec req-32ae6fe9-b9f9-4544-a704-07c65f02922c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:58.142150 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-afd1cad7-621c-4a77-89d4-de4a655e5aec req-32ae6fe9-b9f9-4544-a704-07c65f02922c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1122117 May 26 14:49:58.208709 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-afd1cad7-621c-4a77-89d4-de4a655e5aec req-3febe3b5-f499-4554-84b6-024b9e5acef6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0598691 May 26 14:49:58.239112 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-253daa57-3b17-4bfb-9411-aba8418605f8 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1588495 May 26 14:49:58.386470 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-827c60ba-db2a-4f21-b427-8b1eb7219908 req-c2713950-3911-4a08-a496-589b7bc2f82f service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1404729 May 26 14:49:59.417001 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9384a90-a258-445a-b7a7-ab8a32ee0fc7 req-be97bf6e-ac00-4d3e-b390-b473e671cf54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:49:59.418833 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e9384a90-a258-445a-b7a7-ab8a32ee0fc7 req-be97bf6e-ac00-4d3e-b390-b473e671cf54 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0910988 May 26 14:49:59.466520 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e9384a90-a258-445a-b7a7-ab8a32ee0fc7 req-e1ffa818-1720-4ae4-9db0-07174f3e41b9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393991 May 26 14:49:59.573132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 46994) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:00.404116 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:00.839441 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Deleting port 926d9d5c-2945-44cb-898f-bc6ea47b2a43 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:50:00.840161 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:00.966759 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40606cf1-5127-49bb-a71b-21beb8e931e5 req-269ca9a3-9a36-42a7-b051-72c2233b76c5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:00.968375 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-40606cf1-5127-49bb-a71b-21beb8e931e5 req-269ca9a3-9a36-42a7-b051-72c2233b76c5 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0813541 May 26 14:50:01.014345 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-40606cf1-5127-49bb-a71b-21beb8e931e5 req-7e3274e5-31eb-4cd4-bf79-b2f55243c820 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399489 May 26 14:50:01.029268 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] For port 926d9d5c-2945-44cb-898f-bc6ea47b2a43, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=926d9d5c-2945-44cb-898f-bc6ea47b2a43,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:01.029620 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:01.162239 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Calling delete_port for 926d9d5c-2945-44cb-898f-bc6ea47b2a43 owned by network:router_interface {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:50:01.172080 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-f719deea-1ab0-46c1-9265-e06134fdcf1e service neutron] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2482364 May 26 14:50:01.491856 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:50:01.588825 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:01.593945 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:01.643240 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Pushing event deleted for resources: {'Port': ['ID=926d9d5c-2945-44cb-898f-bc6ea47b2a43,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:01.649239 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:01.924745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:02.219964 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd56286-b2a3-42ae-a49a-2108eb2acb8a req-1ddd31fc-2d35-4f9a-bd1d-895edbc16c2b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:02.221424 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8cd56286-b2a3-42ae-a49a-2108eb2acb8a req-1ddd31fc-2d35-4f9a-bd1d-895edbc16c2b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0876584 May 26 14:50:02.266942 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8cd56286-b2a3-42ae-a49a-2108eb2acb8a req-33bd109e-e0c9-416c-a784-a65381d826af tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392866 May 26 14:50:02.328641 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-7abc3d89-6474-4d8a-b62a-2af6308856c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:02.330193 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-7abc3d89-6474-4d8a-b62a-2af6308856c7 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a&tenant_id=f2b58b2245f643ac9193934fdab405c5 HTTP/1.1" status: 200 len: 1096 time: 0.2439868 May 26 14:50:02.359063 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Router 3865f36a-0ff1-4ceb-997f-e7f4306675ef has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:50:02.593198 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-d432d320-250e-48ba-aef8-2fc9a8f93ae9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:02.594704 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-d432d320-250e-48ba-aef8-2fc9a8f93ae9 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1096 time: 0.2289441 May 26 14:50:02.595812 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:50:02.606666 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] Sync routers for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:50:02.617008 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:50:02.617654 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:02.628546 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] 10.222.0.72 "PUT /v2.0/routers/3865f36a-0ff1-4ceb-997f-e7f4306675ef/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0543022 May 26 14:50:02.631770 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47056) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:02.737840 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-29fd02d7-78d6-4f8c-a2e0-3db9853b04b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:02.739421 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-29fd02d7-78d6-4f8c-a2e0-3db9853b04b9 service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1344063 May 26 14:50:02.798967 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:50:02.917637 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks [] for router, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:02.955052 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-261ef908-a2f0-4afe-8fc2-26b23cfbb018 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 200 len: 999 time: 0.2083781 May 26 14:50:03.022102 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-e89288d8-7661-4422-8d32-1ab0ef1aa0bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:03.023620 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-e89288d8-7661-4422-8d32-1ab0ef1aa0bf service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0614789 May 26 14:50:03.094867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:03.102420 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-9d1d79e1-e852-4204-b4e0-6d6e276c647a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:03.103994 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-9d1d79e1-e852-4204-b4e0-6d6e276c647a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0727241 May 26 14:50:03.128307 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35'}], 'enable_snat': True}, 'gw_port_id': '878df695-7300-4df7-af49-82e0eea671af', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:50:01Z', 'revision_number': 5, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port': {'id': '878df695-7300-4df7-af49-82e0eea671af', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:d0:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:49Z', 'updated_at': '2021-05-26T14:43:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:03.133186 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] Checking router: 3865f36a-0ff1-4ceb-997f-e7f4306675ef for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:50:03.142707 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] Routers {'3865f36a-0ff1-4ceb-997f-e7f4306675ef'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:50:03.143598 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:49:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:03.174579 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Deleting port 878df695-7300-4df7-af49-82e0eea671af {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:50:03.174840 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:03.244081 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-20dee52a-61bc-466c-8c38-28e453399a88 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1321714 May 26 14:50:03.297165 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] For port 878df695-7300-4df7-af49-82e0eea671af, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=878df695-7300-4df7-af49-82e0eea671af,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:03.297804 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] Set router 3865f36a-0ff1-4ceb-997f-e7f4306675ef gateway port host: None {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:50:03.297944 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:03.401947 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c2c9ff52-4f66-4382-b947-9a7da77f32c1 req-a67257bc-f2ef-488b-8793-aa8170b39a31 service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1496189 May 26 14:50:03.404375 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:50:03Z', 'revision_number': 6, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:03.408411 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91ac4a2a-22b3-429e-8f42-4acd7f72da63 None None] The sync data for ids ['3865f36a-0ff1-4ceb-997f-e7f4306675ef'] in dv-cinder-774594-6-iscsi is: [{'id': '3865f36a-0ff1-4ceb-997f-e7f4306675ef', 'name': 'tempest-AttachVolumeTestJSON-1046636222-router', 'tenant_id': 'c906c656a3474e64ab918724c042f2be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:47Z', 'updated_at': '2021-05-26T14:50:03Z', 'revision_number': 6, 'project_id': 'c906c656a3474e64ab918724c042f2be', 'gw_port_host': None}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:50:03.424149 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Calling delete_port for 878df695-7300-4df7-af49-82e0eea671af owned by network:router_gateway {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:50:03.527913 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ceea7a4-bd4d-4836-84b6-7b21e56794d3 req-97419d07-55ca-4dc3-9422-049bae63790a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:03.529430 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ceea7a4-bd4d-4836-84b6-7b21e56794d3 req-97419d07-55ca-4dc3-9422-049bae63790a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1126451 May 26 14:50:03.596911 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1ceea7a4-bd4d-4836-84b6-7b21e56794d3 req-a5da9f6d-c74c-40a8-93d7-557b226a2a3b tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0589941 May 26 14:50:03.677270 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:03.681330 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6c672169-9271-451b-befe-0529ab80ec90 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:03.729730 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Pushing event deleted for resources: {'Port': ['ID=878df695-7300-4df7-af49-82e0eea671af,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:03.732376 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:03.823566 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.064273 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.067295 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.114081 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.115005 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3865f36a-0ff1-4ceb-997f-e7f4306675ef {{(pid=98445) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:50:04.146895 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.150463 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] 10.222.0.72 "DELETE /v2.0/routers/3865f36a-0ff1-4ceb-997f-e7f4306675ef HTTP/1.1" status: 204 len: 168 time: 1.5155525 May 26 14:50:04.151309 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47084) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:04.226144 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] Deleting subnet 0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:50:04.229595 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.309650 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.372631 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 878df695-7300-4df7-af49-82e0eea671af no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:50:04.422194 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 878df695-7300-4df7-af49-82e0eea671af {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:50:04.422629 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 878df695-7300-4df7-af49-82e0eea671af not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:50:04.422987 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 926d9d5c-2945-44cb-898f-bc6ea47b2a43 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:50:04.457527 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 926d9d5c-2945-44cb-898f-bc6ea47b2a43 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:50:04.458119 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 926d9d5c-2945-44cb-898f-bc6ea47b2a43 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:50:04.488700 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.770335 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.770335 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:04.807607 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0ff14072-b6ed-4e7e-acdf-9c02d2a054b3,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:04.813724 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:04.815265 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ebe6dd-5436-4581-8185-3f06fe8aa658 req-5d292fbe-d3da-4bdb-aece-fa3f2571f845 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:04.816550 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:04.816798 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-87ebe6dd-5436-4581-8185-3f06fe8aa658 req-5d292fbe-d3da-4bdb-aece-fa3f2571f845 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0934141 May 26 14:50:04.822926 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad1f8249-0715-43ad-bffe-3ecc7aab226a None None] Network 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:50:04.826919 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-3c59dffa-cf3d-48fc-bb77-9cc854e0f9c3 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/0ff14072-b6ed-4e7e-acdf-9c02d2a054b3 HTTP/1.1" status: 204 len: 168 time: 0.6721187 May 26 14:50:04.827290 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47092) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:05.085056 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-87ebe6dd-5436-4581-8185-3f06fe8aa658 req-143ab191-09e0-40fb-aba3-4b926bb8ef0e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2356200 May 26 14:50:05.094333 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.115001 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] DHCP port deletion for 82f940d8-9b5b-4a1a-9b79-05f05dbfa116 request from dv-cinder-774594-6-iscsi {{(pid=98446) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 26 14:50:05.180923 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Deleting port d8bd9445-9a77-4cb4-88c8-49787862e2d2 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:50:05.181356 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.204116 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] Deleting port d8bd9445-9a77-4cb4-88c8-49787862e2d2 {{(pid=98446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:50:05.204510 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.287306 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] For port d8bd9445-9a77-4cb4-88c8-49787862e2d2, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d8bd9445-9a77-4cb4-88c8-49787862e2d2,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:05.287672 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.336007 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] For port d8bd9445-9a77-4cb4-88c8-49787862e2d2, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d8bd9445-9a77-4cb4-88c8-49787862e2d2,segment=NetworkSegment(567291f9-aa99-493c-b4d7-e95dc1f1b3f2),segment_id=567291f9-aa99-493c-b4d7-e95dc1f1b3f2)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:05.336386 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.416670 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Calling delete_port for d8bd9445-9a77-4cb4-88c8-49787862e2d2 owned by network:dhcp {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:50:05.458964 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] Calling delete_port for d8bd9445-9a77-4cb4-88c8-49787862e2d2 owned by network:dhcp {{(pid=98446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:50:05.485198 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.490054 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-840cbdf3-d772-4f31-bb27-fdb3a3869e63 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:05.504572 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933'] for port, after_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.509077 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:05.535158 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Pushing event deleted for resources: {'Port': ['ID=d8bd9445-9a77-4cb4-88c8-49787862e2d2,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:05.538332 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:05.539026 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] No DVR routers for this DVR port d8bd9445-9a77-4cb4-88c8-49787862e2d2 on host dv-cinder-774594-6-iscsi {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:50:05.556288 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] Pushing event deleted for resources: {'Port': ['ID=d8bd9445-9a77-4cb4-88c8-49787862e2d2,revision_number=None']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:05.567677 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] No DVR routers for this DVR port d8bd9445-9a77-4cb4-88c8-49787862e2d2 on host dv-cinder-774594-6-iscsi {{(pid=98446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:50:05.569464 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:05.659204 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.672848 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['82f940d8-9b5b-4a1a-9b79-05f05dbfa116']}} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:05.689022 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '567291f9-aa99-493c-b4d7-e95dc1f1b3f2') {'for_net_delete': True} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:05.689274 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '567291f9-aa99-493c-b4d7-e95dc1f1b3f2') {} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:05.702492 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2677883'] for segment, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.718985 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.729182 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Releasing vlan 1134 on physical network physnet1 to pool {{(pid=98445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:50:05.729623 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2334298'] for segment, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: Traceback (most recent call last): May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: timer() May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: cb(*args, **kw) May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: return func(*args, **kwargs) May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: self._notify() May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: self.callback(batched_events) May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: event.method(event) May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: return f(self, *a, **k) May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._get(url).json() May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: return self.request(url, 'GET', **kwargs) May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:50:05.798049 dv-cinder-774594-6-iscsi neutron-server[98445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:50:05.826246 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.830414 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:05.846093 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:05.857148 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Pushing event deleted for resources: {'Network': ['ID=82f940d8-9b5b-4a1a-9b79-05f05dbfa116,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:05.860871 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:05.873391 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3d5ef34f-1212-4b47-9b41-56d51cc66010 admin admin] 10.222.0.72 "DELETE /v2.0/networks/82f940d8-9b5b-4a1a-9b79-05f05dbfa116 HTTP/1.1" status: 204 len: 168 time: 1.0449703 May 26 14:50:05.998578 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47100) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:06.053399 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-ea22aad2-083a-42e9-b4db-0310a4fc94ba admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=c906c656a3474e64ab918724c042f2be&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0534935 May 26 14:50:06.055990 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47104) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:06.129393 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1d72149a-8acf-4351-be8c-d2e9758aaed8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:06.161706 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1d72149a-8acf-4351-be8c-d2e9758aaed8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:06.272272 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1d72149a-8acf-4351-be8c-d2e9758aaed8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:06.278731 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f9f663a8-622c-4c8d-8c07-de333cf0b7f8 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:06.301204 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d72149a-8acf-4351-be8c-d2e9758aaed8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e764c521-910b-4b8a-9e11-bf5a82e0036b,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:06.306692 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1d72149a-8acf-4351-be8c-d2e9758aaed8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:06.314627 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1d72149a-8acf-4351-be8c-d2e9758aaed8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:06.315749 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-1d72149a-8acf-4351-be8c-d2e9758aaed8 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/e764c521-910b-4b8a-9e11-bf5a82e0036b HTTP/1.1" status: 204 len: 168 time: 0.2586429 May 26 14:50:06.353499 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5e36617-b264-451d-8c54-53496aa0f7f0 req-b0b2a99a-e0bf-4317-9418-817d2cfe383c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:06.357442 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5e36617-b264-451d-8c54-53496aa0f7f0 req-b0b2a99a-e0bf-4317-9418-817d2cfe383c tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1377184 May 26 14:50:06.371388 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d8bd9445-9a77-4cb4-88c8-49787862e2d2 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:50:06.410525 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5e36617-b264-451d-8c54-53496aa0f7f0 req-fb94ef7f-4a2c-4d8b-8f88-1f44472e4a5e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464680 May 26 14:50:06.443542 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: d8bd9445-9a77-4cb4-88c8-49787862e2d2 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:50:06.443971 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d8bd9445-9a77-4cb4-88c8-49787862e2d2 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:50:07.299683 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-739c600b-0120-4a12-a5a3-c4dcd7170918 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Synchronizing usage tracker for tenant:054087186333487b82b9a7a12d02c80f on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:50:07.341175 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-739c600b-0120-4a12-a5a3-c4dcd7170918 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Unset dirty status for tenant:054087186333487b82b9a7a12d02c80f on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:50:07.349312 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-739c600b-0120-4a12-a5a3-c4dcd7170918 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1100445324&fields=id&tenant_id=054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 267 time: 0.0972211 May 26 14:50:07.510213 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-7c75202a-d5f0-4596-b127-af3d26e4ad16 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:07.511661 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-7c75202a-d5f0-4596-b127-af3d26e4ad16 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Synchronizing usage tracker for tenant:054087186333487b82b9a7a12d02c80f on resource:network {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:50:07.546460 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-7c75202a-d5f0-4596-b127-af3d26e4ad16 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Unset dirty status for tenant:054087186333487b82b9a7a12d02c80f on resource:network {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:50:07.547899 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-7c75202a-d5f0-4596-b127-af3d26e4ad16 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 811 time: 0.1975541 May 26 14:50:07.563106 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-36593e22-6dcc-41ba-9369-60f0c7dfb57c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/quotas/054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 375 time: 0.0095968 May 26 14:50:07.707955 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a95c9a-e612-498a-bf6a-6cd485e8ca00 req-762160b1-11a1-4f79-8985-ffc14e8e3bcd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:07.709447 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b7a95c9a-e612-498a-bf6a-6cd485e8ca00 req-762160b1-11a1-4f79-8985-ffc14e8e3bcd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1454952 May 26 14:50:07.737756 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-b3b08cc4-16a0-4dba-bdb5-853aae880e0e tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1387873 May 26 14:50:07.791667 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b7a95c9a-e612-498a-bf6a-6cd485e8ca00 req-be00216e-bd62-4873-a019-7e38c7a114cd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0754828 May 26 14:50:07.903542 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-e0980917-2315-4f66-a3e8-d2013155643e service neutron] 10.222.0.72 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1491466 May 26 14:50:08.049720 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-5ace7f89-464a-4bed-9a22-60718c5ee8a3 service neutron] 10.222.0.72 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1392682 May 26 14:50:08.454673 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47180) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:08.663689 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:08.681343 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:50:08.693425 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d8b52fe1-a7ad-4cc3-88cc-a7faaa73f861 req-49e561b2-0c59-4860-a17c-3899c63800f4 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.2003231 May 26 14:50:08.699350 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Usage tracker for resource:security_group_rule and tenant:967e087ac4b04604a22e2dc24f5aa7d7 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:50:08.714662 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:50:08.738384 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:50:08.853384 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:08.860935 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:08.870887 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c4052fc8-cc01-415b-b31f-10c8f5912031 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:08.917836 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=240393a8-6162-479c-995f-92f8be386f4f,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:08.925250 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47196) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:08.925615 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=967e087ac4b04604a22e2dc24f5aa7d7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4695184 May 26 14:50:08.933856 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.934525 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.935186 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.935691 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.936212 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.936727 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.937243 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.937748 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.938246 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.938771 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.939275 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.939768 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:08.955131 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:09.060833 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ed41ffae-6d89-457b-88f4-65a889315a5b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:09.098342 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00b84f29-457c-4855-b1ed-53fb418a6054 req-a23c13f1-421b-42dd-a4b3-f57abb6bbe5f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:09.100872 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-00b84f29-457c-4855-b1ed-53fb418a6054 req-a23c13f1-421b-42dd-a4b3-f57abb6bbe5f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1537554 May 26 14:50:09.113996 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ed41ffae-6d89-457b-88f4-65a889315a5b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:09.183063 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-00b84f29-457c-4855-b1ed-53fb418a6054 req-fa2aaa9f-0164-40c5-ab2f-1607b5b73d86 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0718951 May 26 14:50:09.226679 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ed41ffae-6d89-457b-88f4-65a889315a5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:09.236971 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-96caa39b-fe46-461a-8824-c4b461a9f792 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:09.249927 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed41ffae-6d89-457b-88f4-65a889315a5b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=240393a8-6162-479c-995f-92f8be386f4f,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:09.252303 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ed41ffae-6d89-457b-88f4-65a889315a5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:09.253687 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ed41ffae-6d89-457b-88f4-65a889315a5b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:09.254801 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-ed41ffae-6d89-457b-88f4-65a889315a5b admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/240393a8-6162-479c-995f-92f8be386f4f HTTP/1.1" status: 204 len: 168 time: 0.3284373 May 26 14:50:09.873679 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-46ed1500-f3c4-479d-9573-62d21652c5e7 req-ee3ebf0f-c7db-45d2-b9d4-4ea2a701ca46 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0523314 May 26 14:50:10.417329 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611270d4-54dc-4ca0-895b-7188b85f2bb2 req-4a7d91e0-a296-4172-b979-3b69c228b090 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:10.419156 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-611270d4-54dc-4ca0-895b-7188b85f2bb2 req-4a7d91e0-a296-4172-b979-3b69c228b090 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0878434 May 26 14:50:10.473994 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-611270d4-54dc-4ca0-895b-7188b85f2bb2 req-15f91b3b-1be5-4aec-9942-069164c6e196 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483983 May 26 14:50:11.041356 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f1bd7554-e29b-4e2f-b9a7-e146fc04c69d req-88cc3bc9-2599-4a13-80d8-c28ff05103e8 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0561180 May 26 14:50:11.686671 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c219a09-d875-4c70-8f5a-1a339ada68b8 req-8446f34f-be2b-43c9-920f-c481d4dced78 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:11.688478 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1c219a09-d875-4c70-8f5a-1a339ada68b8 req-8446f34f-be2b-43c9-920f-c481d4dced78 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0895131 May 26 14:50:11.738946 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1c219a09-d875-4c70-8f5a-1a339ada68b8 req-f7f248a1-5e2f-427b-b1db-3494f5f47343 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441051 May 26 14:50:12.199755 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3fb38551-33c4-4ea2-aaba-1dc842a6560b req-2aa0ba87-5f77-4af8-92f8-5f9ae72389ae tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0479195 May 26 14:50:12.969332 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8638ffbd-7068-4d22-9f6b-a55a2901e7f8 req-c8392d9a-b9f0-4cae-875f-0c4167534225 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:12.970829 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8638ffbd-7068-4d22-9f6b-a55a2901e7f8 req-c8392d9a-b9f0-4cae-875f-0c4167534225 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0896108 May 26 14:50:13.016710 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8638ffbd-7068-4d22-9f6b-a55a2901e7f8 req-0fcc229f-f8a8-48d3-b74c-9463db7014e4 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398798 May 26 14:50:13.372239 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-793e9f09-e747-4fcb-93d4-b4953555386e req-ce841391-a640-4d3f-a97f-026244b7f93d tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0496619 May 26 14:50:14.218651 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe73cab4-5035-4a08-b3cf-f8cd036abd1e req-2a3d2130-11f1-4ad4-a588-5782bada3956 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:14.220132 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fe73cab4-5035-4a08-b3cf-f8cd036abd1e req-2a3d2130-11f1-4ad4-a588-5782bada3956 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0875196 May 26 14:50:14.271800 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fe73cab4-5035-4a08-b3cf-f8cd036abd1e req-2e533015-73da-488f-a309-c74b0d38d30a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446441 May 26 14:50:14.531356 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ec2e96b1-92d5-4155-9fc1-efb3f25b49d8 req-dd69f293-c6b3-489d-ac93-550a4a2bacf1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0442801 May 26 14:50:15.500160 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a349fb-0c59-4f96-8365-b9e4e4410679 req-03dc6f73-73f0-45b6-92f3-c221520b11d9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:15.501618 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-38a349fb-0c59-4f96-8365-b9e4e4410679 req-03dc6f73-73f0-45b6-92f3-c221520b11d9 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0947318 May 26 14:50:15.562658 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-38a349fb-0c59-4f96-8365-b9e4e4410679 req-76a208ab-a056-45be-b8e4-bd2b4f91e2b8 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0543778 May 26 14:50:15.689166 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-94acb5e5-62e1-430d-83da-167b30bad2f2 req-ed830afd-8858-4627-b5d7-24c12f1603c6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0518029 May 26 14:50:16.776811 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc9091c-a353-4db4-b930-2e0ba0c1cde0 req-29d2990e-67bb-4103-9c4a-3ddfd5782b37 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:16.778241 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc9091c-a353-4db4-b930-2e0ba0c1cde0 req-29d2990e-67bb-4103-9c4a-3ddfd5782b37 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.0953903 May 26 14:50:16.852595 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e7c2e01b-2c5c-42b2-9f9e-93ad6dc7036f req-5f1a89e0-4d93-40f7-b9a8-bcd858b08379 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0506849 May 26 14:50:16.863271 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-bdc9091c-a353-4db4-b930-2e0ba0c1cde0 req-05e5dd39-3f1d-497a-9b7f-4f6d752f4574 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0793567 May 26 14:50:18.046245 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9b2ab14c-f64d-4888-a24d-3315e5c9008c req-09161074-4a25-45bf-a716-4d3d2895ba28 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0819595 May 26 14:50:18.102142 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4f0c019-8571-482a-9582-aca6bc5a48ce req-da2d93d6-be35-4765-b784-34a67002a52e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:18.107400 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e4f0c019-8571-482a-9582-aca6bc5a48ce req-da2d93d6-be35-4765-b784-34a67002a52e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1000433 May 26 14:50:18.137982 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-421c6ece-a59d-4e35-a48a-8aef0c7a8fe3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:18.140028 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-421c6ece-a59d-4e35-a48a-8aef0c7a8fe3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 811 time: 0.1547635 May 26 14:50:18.150136 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e4f0c019-8571-482a-9582-aca6bc5a48ce req-730dfddb-254a-4e7a-a7c3-781530318377 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403244 May 26 14:50:18.197372 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-b70597f4-fec2-4bd2-a5eb-74c9dddc5a5d tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Synchronizing usage tracker for tenant:054087186333487b82b9a7a12d02c80f on resource:security_group {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:50:18.209594 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-b70597f4-fec2-4bd2-a5eb-74c9dddc5a5d tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Unset dirty status for tenant:054087186333487b82b9a7a12d02c80f on resource:security_group {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:50:18.210772 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-b70597f4-fec2-4bd2-a5eb-74c9dddc5a5d tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 380 time: 0.0543873 May 26 14:50:18.222105 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'port': {'device_id': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'admin_state_up': True, 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'security_groups': ['ccbc02f3-8afe-463e-99ee-7fa02c671594']}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:50:18.362856 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:50:18.367288 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:port and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:50:18.370569 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:50:18.376663 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:50:18.387629 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Made reservation on behalf of 054087186333487b82b9a7a12d02c80f for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:50:18.391279 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:18.733947 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Allocated IP 172.20.0.10 (0a3b5429-9434-492a-ba57-3dfc671d164c/be983207-7be6-448d-b3eb-3c77c2c0eda1/e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:50:18.936621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:18.954262 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Transition to ACTIVE for port object e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:50:18.980595 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:18.986623 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-04729dd8-2c4e-4a1a-8ec7-30a5ed52938e tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:19.059116 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Network 0a3b5429-9434-492a-ba57-3dfc671d164c is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:50:19.062339 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:50:19.066493 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:50:19.109128 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:19.120652 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:19.152255 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:19.152943 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:19.180559 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9620101 May 26 14:50:19.208686 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Request body: {'port': {'device_id': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:50:19.309095 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd6b898-da90-45b7-81b5-2949040c3f56 req-7649d4b7-e844-4168-acd7-ab186badbee8 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:19.316939 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7dd6b898-da90-45b7-81b5-2949040c3f56 req-7649d4b7-e844-4168-acd7-ab186badbee8 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 932 time: 0.1112747 May 26 14:50:19.369885 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:19.409486 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7dd6b898-da90-45b7-81b5-2949040c3f56 req-c715e171-6f77-4e59-86ed-439afbed1bff tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0911715 May 26 14:50:19.442997 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-4338984c-ef23-4727-8e8d-8b66b88c6ce8 None None] Provisioning for port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:50:19.448509 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-4338984c-ef23-4727-8e8d-8b66b88c6ce8 None None] Provisioning complete for port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:50:19.449005 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-4338984c-ef23-4727-8e8d-8b66b88c6ce8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:19.456887 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39dad756-8de2-4855-86e8-3f233ba75d7b req-0cb1fe03-9582-4fe2-a712-8593868551d7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:19.462966 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-39dad756-8de2-4855-86e8-3f233ba75d7b req-0cb1fe03-9582-4fe2-a712-8593868551d7 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 943 time: 0.1055820 May 26 14:50:19.502334 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-4338984c-ef23-4727-8e8d-8b66b88c6ce8 None None] Port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:50:19.505718 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-39dad756-8de2-4855-86e8-3f233ba75d7b req-e9cd7426-14f2-4462-9665-b3b6371e0c83 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406320 May 26 14:50:19.608034 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:50:19.725189 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:50:19.732825 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:19.742146 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:19.747337 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Transition to ACTIVE for port object e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:50:19.752441 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:19.755659 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '210e790a-2172-4934-bf39-2d9aecd01a92', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'port_id': '210e790a-2172-4934-bf39-2d9aecd01a92', 'mac_address': 'fa:16:3e:3b:ad:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:50:19.757144 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-73ec641e-db8d-4ed2-9b9c-1c798ddd7cfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:19.812701 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:19.830498 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 210e790a-2172-4934-bf39-2d9aecd01a92 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:50:19.848556 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:19.853967 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:19.856248 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:19.926734 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=9']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:19.929984 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:19.953342 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Pushing event updated for resources: {'Port': ['ID=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:19.964442 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:20.001599 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Attempting to bind port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:50:20.001846 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Attempting to bind port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:50:20.002164 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Attempting to bind port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 on network 0a3b5429-9434-492a-ba57-3dfc671d164c {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:50:20.006908 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 on network 0a3b5429-9434-492a-ba57-3dfc671d164c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:50:20.007218 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Attempting to bind port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 on network 0a3b5429-9434-492a-ba57-3dfc671d164c {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:50:20.012317 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 49, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:50:20.012637 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Checking segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:50:20.013012 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Bound using segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:50:20.013452 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Bound port: e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:50:20.013783 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:20.105276 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] For port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:50:20.108140 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] For port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:50:20.113893 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:20.117816 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d0213383-4bf7-4ad2-8bc6-14f96a04803b tempest-VolumesSnapshotTestJSON-1903790064 tempest-VolumesSnapshotTestJSON-1903790064-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:20.137630 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['210e790a-2172-4934-bf39-2d9aecd01a92'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:50:20.174735 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:20.175395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:20.176735 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] 10.222.0.79 "PUT /v2.0/ports/e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 HTTP/1.1" status: 200 len: 1094 time: 0.9812973 May 26 14:50:20.177224 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'tag': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:50:20.196113 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Pushing event updated for resources: {'Port': ['ID=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:20.199460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:20.276117 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'tag': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'status': 'completed', 'code': 200} May 26 14:50:20.319570 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-10bd0810-a796-4f0d-8bdf-d027d26e64ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:20.321148 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-10bd0810-a796-4f0d-8bdf-d027d26e64ac service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 1097 time: 0.0841846 May 26 14:50:20.397047 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-b1c72432-d624-4758-bebc-6ab7fb3f7b35 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 HTTP/1.1" status: 200 len: 217 time: 0.0627728 May 26 14:50:20.463159 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-f17a3950-d402-4881-b22a-a0ab7f86bebd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:20.464597 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-f17a3950-d402-4881-b22a-a0ab7f86bebd service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0614424 May 26 14:50:20.548042 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bb8ef04f-53c9-4ea3-990f-5ead15d5be51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:20.549687 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-bb8ef04f-53c9-4ea3-990f-5ead15d5be51 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0783379 May 26 14:50:20.606407 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fba2ac6-5c58-45b7-b154-c36b265d5af6 req-0ee35a80-0437-4b3a-9a06-3c535aaea1b7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:20.608582 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fba2ac6-5c58-45b7-b154-c36b265d5af6 req-0ee35a80-0437-4b3a-9a06-3c535aaea1b7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 944 time: 0.0863972 May 26 14:50:20.711375 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fba2ac6-5c58-45b7-b154-c36b265d5af6 req-9fee5641-45b3-46bf-9adf-2b83b35e60e6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0875096 May 26 14:50:20.740404 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eac513e2-8b83-4360-9f7b-f25373eae5ae req-d34878d1-290d-4dcc-9a0d-a51eb8e2f4dd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:20.741864 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-eac513e2-8b83-4360-9f7b-f25373eae5ae req-d34878d1-290d-4dcc-9a0d-a51eb8e2f4dd tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 944 time: 0.1070309 May 26 14:50:20.787153 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-eac513e2-8b83-4360-9f7b-f25373eae5ae req-6704fb61-cad3-4228-b297-2e3963f3d17e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383523 May 26 14:50:20.796642 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-87b2a569-b114-4fb8-8d98-baa72a1befb7 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2399511 May 26 14:50:20.932439 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-83de2bf4-6283-49a3-b118-cde4b1adab8b req-fc5fc281-e9bc-42cd-a4bb-c8a6ab5fcda9 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281397 May 26 14:50:21.097855 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-89ad1596-0e8c-4044-993a-e5cfa714df59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:21.099466 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-89ad1596-0e8c-4044-993a-e5cfa714df59 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 1097 time: 0.0808034 May 26 14:50:21.244086 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-f6dd3e65-9c82-4b79-9708-76ced4b36195 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:21.245589 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-f6dd3e65-9c82-4b79-9708-76ced4b36195 service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1399872 May 26 14:50:21.317094 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-541011c1-c3f5-4977-b6af-d736d5dd0919 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 HTTP/1.1" status: 200 len: 217 time: 0.0644162 May 26 14:50:21.387315 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-a9733585-5a9a-444a-b279-c51debc0b7dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:21.388634 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-a9733585-5a9a-444a-b279-c51debc0b7dc service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0649588 May 26 14:50:21.478239 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-9b2276f1-184e-4aae-83c3-95762724ad69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:21.479766 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-9b2276f1-184e-4aae-83c3-95762724ad69 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0830891 May 26 14:50:21.616678 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:50:21.625593 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-e62dd70d-0da2-43aa-8181-545980c19a9d service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1388066 May 26 14:50:21.681379 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-059d1e20-1488-47d0-89d0-9999ca497d8b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:21.699220 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 210e790a-2172-4934-bf39-2d9aecd01a92 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:50:21.699600 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:21.764364 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-d9048648-58f9-4ea7-8308-3d267f3cff48 req-70ba0ee9-aafb-4f08-91cd-a52a59804b28 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1312785 May 26 14:50:21.817853 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:21.845977 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:50:21.856837 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:21.861970 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:21.864066 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:21.935777 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=10']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:21.938774 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:22.054049 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-570f4e9b-b13d-4d55-b91d-8802b0a7a7d4 req-9a712a3d-e9db-4699-bb25-4a5913529ce7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:22.055640 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-570f4e9b-b13d-4d55-b91d-8802b0a7a7d4 req-9a712a3d-e9db-4699-bb25-4a5913529ce7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 944 time: 0.2455025 May 26 14:50:22.064615 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3874cc-5727-4480-b377-db4fd17bc930 req-2ae98ffb-2a1f-4f74-8cfd-e639443a9615 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:22.066187 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3874cc-5727-4480-b377-db4fd17bc930 req-2ae98ffb-2a1f-4f74-8cfd-e639443a9615 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 946 time: 0.1185973 May 26 14:50:22.138913 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-570f4e9b-b13d-4d55-b91d-8802b0a7a7d4 req-cf6126c0-a0ba-4d66-a551-f26a3b0487be tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0716898 May 26 14:50:22.146864 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9d3874cc-5727-4480-b377-db4fd17bc930 req-95e0f929-c63f-4472-bcac-e676698b9c7d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0651443 May 26 14:50:22.200383 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92', 'code': 200} May 26 14:50:22.498197 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7029ecb2-8b83-4ac9-ba7a-6decb7147a86 req-b25eb6dd-373b-4d9a-91bc-70fa8b84664e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:22.499797 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-7029ecb2-8b83-4ac9-ba7a-6decb7147a86 req-b25eb6dd-373b-4d9a-91bc-70fa8b84664e service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1099 time: 0.0728786 May 26 14:50:22.546133 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-7029ecb2-8b83-4ac9-ba7a-6decb7147a86 req-7378403d-0b86-45b9-ac10-87bf469537e0 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399861 May 26 14:50:23.229244 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:50:23.269652 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a7db469d-26f8-460a-ab59-bb47c03c8b21 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:23.393659 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf250743-4828-41d5-8df0-9bc4b16a0748 req-84f153a1-75e2-4a7e-9e72-a0d2fc3b0b1e tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:23.395117 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cf250743-4828-41d5-8df0-9bc4b16a0748 req-84f153a1-75e2-4a7e-9e72-a0d2fc3b0b1e tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 944 time: 0.1390078 May 26 14:50:23.404995 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-235f7678-756b-4de9-ba0f-82c165c9db96 req-a30f4565-aa4a-4884-8ac7-4153f602a13d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:23.406330 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-235f7678-756b-4de9-ba0f-82c165c9db96 req-a30f4565-aa4a-4884-8ac7-4153f602a13d tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 946 time: 0.1188250 May 26 14:50:23.476000 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cf250743-4828-41d5-8df0-9bc4b16a0748 req-5c31b551-8889-4652-93b1-86869eb31ae5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0687404 May 26 14:50:23.478666 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-235f7678-756b-4de9-ba0f-82c165c9db96 req-73325923-cc7c-4401-ad6b-52b5c97660ae tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0586345 May 26 14:50:24.568960 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:24.723577 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04708a7d-a1fb-4fdc-bb57-5c903da0bb1b req-3a7b6622-7c24-4186-bb95-1ea58b333426 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:24.725596 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-04708a7d-a1fb-4fdc-bb57-5c903da0bb1b req-3a7b6622-7c24-4186-bb95-1ea58b333426 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 944 time: 0.1371491 May 26 14:50:24.735853 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fba0b7a-40b1-4d62-9559-9896b01e624e req-9b6b9717-80b7-4144-bf35-9621e56312c3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:24.737213 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0fba0b7a-40b1-4d62-9559-9896b01e624e req-9b6b9717-80b7-4144-bf35-9621e56312c3 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 946 time: 0.1154203 May 26 14:50:24.807788 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-04708a7d-a1fb-4fdc-bb57-5c903da0bb1b req-eaad98f4-5976-45c7-a893-894573e02dd1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0695467 May 26 14:50:24.812077 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0fba0b7a-40b1-4d62-9559-9896b01e624e req-dbe45822-331a-48bd-99cc-da53c64a0393 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0602279 May 26 14:50:25.885067 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:25.909654 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:26.162409 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d828733-b2cd-4fe2-b642-fd6535554117 req-07c20ca2-f251-4239-b398-e508d2ee261c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:26.163843 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2d828733-b2cd-4fe2-b642-fd6535554117 req-07c20ca2-f251-4239-b398-e508d2ee261c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 944 time: 0.0812573 May 26 14:50:26.208379 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2d828733-b2cd-4fe2-b642-fd6535554117 req-5f2b86eb-a4ce-4f0a-b877-c5eb45ead9fb tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386620 May 26 14:50:27.419334 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f023bf-33a5-481e-be84-d38e14f292c0 req-70315384-6ea5-43b5-b3a7-8729b8e1eb21 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:27.420651 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52f023bf-33a5-481e-be84-d38e14f292c0 req-70315384-6ea5-43b5-b3a7-8729b8e1eb21 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 944 time: 0.0865090 May 26 14:50:27.467255 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52f023bf-33a5-481e-be84-d38e14f292c0 req-6b9f89b3-e4ea-4f48-bb55-2f1b5a378e7e tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400088 May 26 14:50:27.490226 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:27.622072 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:50:27.762522 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:27.775472 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'port_id': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'mac_address': 'fa:16:3e:fb:f7:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1123, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:50:27.830420 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:27.847506 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:50:27.863802 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:27.869839 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:27.871691 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-1dc6f21f-5c73-4f6d-a762-f720d218c0f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:27.941499 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:27.945146 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:28.158063 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:50:28.671668 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225f8273-05c1-41f4-baa6-20c11528864a req-9521c7a2-5fec-4953-89e6-a4de955e0126 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:28.673219 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-225f8273-05c1-41f4-baa6-20c11528864a req-9521c7a2-5fec-4953-89e6-a4de955e0126 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 945 time: 0.1015041 May 26 14:50:28.722084 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-225f8273-05c1-41f4-baa6-20c11528864a req-433d1e2f-e8f9-4afb-8340-00159c7b72e2 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403628 May 26 14:50:29.647525 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:50:29.724714 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:50:29.729362 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:50:29.729745 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:29.858685 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:29.890905 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:50:29.901382 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:50:29.906717 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:29.909101 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:29.980556 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'code': 200} May 26 14:50:30.013789 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:30.016837 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:30.074704 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e21d65-620a-4683-8862-66e62a5f63b8 req-e9a52783-e20a-4dfe-b87e-9db9dd77d454 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:30.076487 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f7e21d65-620a-4683-8862-66e62a5f63b8 req-e9a52783-e20a-4dfe-b87e-9db9dd77d454 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 946 time: 0.0880945 May 26 14:50:30.122394 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f7e21d65-620a-4683-8862-66e62a5f63b8 req-d514ec70-5b27-4202-a8ad-8d0b35f1480a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397980 May 26 14:50:30.257965 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5299ac-0403-4e60-8b4f-2e9bbc4437cb req-09e7d983-37da-498c-9bcd-d0c88833f62d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:30.259387 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-1a5299ac-0403-4e60-8b4f-2e9bbc4437cb req-09e7d983-37da-498c-9bcd-d0c88833f62d service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 1099 time: 0.0725839 May 26 14:50:30.299321 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-1a5299ac-0403-4e60-8b4f-2e9bbc4437cb req-46d88877-fd48-4d41-8485-2285c1fb1fd9 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338454 May 26 14:50:31.321971 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d58f582-7473-4ad2-b84c-404801e721b5 req-45ff172e-969d-41c6-8e3a-11b9a5e27498 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:31.323458 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1d58f582-7473-4ad2-b84c-404801e721b5 req-45ff172e-969d-41c6-8e3a-11b9a5e27498 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 946 time: 0.0857198 May 26 14:50:31.376690 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1d58f582-7473-4ad2-b84c-404801e721b5 req-a51bb5d0-9949-455b-b1ed-e4e4ef9b25e6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467751 May 26 14:50:32.586248 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0bc77d1-c23e-40d4-a847-341c42e77824 req-8a9af6c3-d5db-4b40-a554-e2cd7948ce45 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:32.587815 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e0bc77d1-c23e-40d4-a847-341c42e77824 req-8a9af6c3-d5db-4b40-a554-e2cd7948ce45 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 946 time: 0.0936055 May 26 14:50:32.635075 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e0bc77d1-c23e-40d4-a847-341c42e77824 req-d7cd5aae-4e92-4870-acf5-929c41506163 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414991 May 26 14:50:32.828569 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-730fd025-e216-4e93-a959-496ad76ead3f req-ad228621-f2f0-44a1-99a0-f3353dc88e66 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:32.829997 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-730fd025-e216-4e93-a959-496ad76ead3f req-ad228621-f2f0-44a1-99a0-f3353dc88e66 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 946 time: 0.0927138 May 26 14:50:32.875486 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-730fd025-e216-4e93-a959-496ad76ead3f req-07bd6001-7b97-4dbb-b397-4cff21cb68cc tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397775 May 26 14:50:32.901396 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47506) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:33.133765 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b97f152-38ad-407a-a4d0-bfd9358ba051 tempest-TestVolumeBootPattern-73066992 tempest-TestVolumeBootPattern-73066992-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:33.135222 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-5b97f152-38ad-407a-a4d0-bfd9358ba051 tempest-TestVolumeBootPattern-73066992 tempest-TestVolumeBootPattern-73066992-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 1094 time: 0.2329109 May 26 14:50:33.138544 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47516) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:33.143794 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'port_id': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address': '172.20.0.10'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:50:33.150199 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:50:33.154505 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:floatingip and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:50:33.157666 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:50:33.165106 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:50:33.176689 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:33.315389 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:33.456609 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Allocated IP 172.27.3.222 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/64852d40-bb25-4e97-9bb7-142e320cd8f9) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:50:33.604163 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:33.644982 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:33.648707 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-828fb69a-b534-4e98-aa5a-e04f690c718f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:33.714476 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:50:33.717296 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:50:33.720118 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:50:33.857733 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=64852d40-bb25-4e97-9bb7-142e320cd8f9,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:33.864513 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:34.231493 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:34.309017 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:34.525935 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:34.531312 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:34.535927 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e4547c2f-8a57-4c97-9c7a-9d982594bf75 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:34.650897 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=64852d40-bb25-4e97-9bb7-142e320cd8f9,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:34.653908 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:34.661227 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:34.836114 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Floating IP 379fb7bf-c0af-4316-b18b-c25404c58164 associated. External IP: 172.27.3.222, port: e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2. May 26 14:50:35.199956 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Router 39443462-555c-4ab6-8ab8-12514f6596b8 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:50:35.488541 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:50:35.501442 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:50:35.511467 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:50:35.512296 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:50:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:35.517826 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:35.576234 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.4362078 May 26 14:50:35.576936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'tag': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:50:35.621093 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'tag': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'status': 'completed', 'code': 200} May 26 14:50:35.692731 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:50:36.066962 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '379fb7bf-c0af-4316-b18b-c25404c58164', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.222', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 545, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:fb:f7:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:50:34Z', 'updated_at': '2021-05-26T14:50:34Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:36.071564 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:50:36.081194 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:50:36.081790 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:50:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:36.291079 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:50:36.639831 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '379fb7bf-c0af-4316-b18b-c25404c58164', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.222', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 545, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:fb:f7:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:50:34Z', 'updated_at': '2021-05-26T14:50:34Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:50:36.643961 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b12f3c40-0cd6-4243-852b-9a768e66567c None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '379fb7bf-c0af-4316-b18b-c25404c58164', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.222', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 545, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:fb:f7:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:50:34Z', 'updated_at': '2021-05-26T14:50:34Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:50:36.839402 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0aee2257-bbd9-4d8a-bcc3-162dd9083845 None None] New status for floating IP 379fb7bf-c0af-4316-b18b-c25404c58164: ACTIVE {{(pid=98446) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:50:37.789660 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-98a01e31-298d-43ac-8e10-52bf61252c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:37.791183 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-98a01e31-298d-43ac-8e10-52bf61252c2b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 1099 time: 0.0745616 May 26 14:50:37.925301 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-7bdeb571-8d5b-4db9-8c7d-87bbd0032fdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:37.926808 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-7bdeb571-8d5b-4db9-8c7d-87bbd0032fdb service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1289344 May 26 14:50:38.034561 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-fee84ecc-5a15-464c-9e56-c21eb42c05f5 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 HTTP/1.1" status: 200 len: 1002 time: 0.1004612 May 26 14:50:39.831339 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-2052a5ce-336e-4bea-bf03-b2a40ee6870a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:39.832790 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-2052a5ce-336e-4bea-bf03-b2a40ee6870a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0729687 May 26 14:50:40.804965 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-cd71481f-c821-496a-8622-5ba5b8d4ecfd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:40.806439 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-cd71481f-c821-496a-8622-5ba5b8d4ecfd service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0906091 May 26 14:50:40.953227 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-a729cb6e-fce2-4044-8b4a-529b0494f5b6 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282308 May 26 14:50:41.090453 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-c280675c-8706-46ef-a0b6-4158fbf61150 req-e9a257d9-eaf0-476d-b6bd-cc71dd58565f service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1303000 May 26 14:50:51.647193 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-313af486-552f-4389-93b4-65b908238fd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:53.281231 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-764a2961-24f4-48a1-a4e5-3ae60b552afe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:54.563845 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:55.883873 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:55.914918 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:56.223263 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47708) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:56.345068 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:56.359964 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:50:56.364468 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Usage tracker for resource:security_group_rule and tenant:8c7d4e9283834db28ff4d8ba62b3be5e is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:50:56.367639 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:50:56.374167 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:50:56.460941 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:56.467713 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:56.477879 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c45eba62-1e92-41ea-bc9a-163e4056c525 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:56.518211 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=8c7d4e9283834db28ff4d8ba62b3be5e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2933886 May 26 14:50:56.519128 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8275654d-b62e-4d90-a19d-153dfabca63c,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:56.521214 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47714) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:56.522562 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:56.582110 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:56.608809 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:56.670344 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:56.674007 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ee3f57a0-951e-4378-aed9-edb2b889111e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:56.684704 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8275654d-b62e-4d90-a19d-153dfabca63c,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:56.694677 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.695054 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.695445 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.695802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.696153 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.696509 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.696858 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.697228 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.697580 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.697920 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.698266 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.698621 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:50:56.702239 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:56.703482 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:56.704652 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/8275654d-b62e-4d90-a19d-153dfabca63c HTTP/1.1" status: 204 len: 168 time: 0.1822016 May 26 14:50:57.009213 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47726) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:57.027478 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:57.042293 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:50:57.046550 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Usage tracker for resource:security_group_rule and tenant:ef71566acbb5476ca8d3d264fa156ec8 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:50:57.049566 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:50:57.055529 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:50:57.144865 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:57.150720 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:57.157547 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-94180a00-1afc-4dbc-b6c0-8cabe0ba7c8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:57.196359 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95da3e6a-27c6-46cf-a562-60a4878d4c70,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:57.200902 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=ef71566acbb5476ca8d3d264fa156ec8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1906519 May 26 14:50:57.201870 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:57.203638 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47730) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:50:57.263709 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ea9f6be8-b72a-4524-9c1d-4b3d6dbce1b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:57.289306 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ea9f6be8-b72a-4524-9c1d-4b3d6dbce1b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:57.347396 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ea9f6be8-b72a-4524-9c1d-4b3d6dbce1b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:57.352127 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3d8c316f-131a-40b5-b674-bb9370f109cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:50:57.363895 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea9f6be8-b72a-4524-9c1d-4b3d6dbce1b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95da3e6a-27c6-46cf-a562-60a4878d4c70,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:50:57.366778 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ea9f6be8-b72a-4524-9c1d-4b3d6dbce1b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:50:57.368887 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-ea9f6be8-b72a-4524-9c1d-4b3d6dbce1b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:57.369941 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-ea9f6be8-b72a-4524-9c1d-4b3d6dbce1b9 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/95da3e6a-27c6-46cf-a562-60a4878d4c70 HTTP/1.1" status: 204 len: 168 time: 0.1654153 May 26 14:50:57.495696 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:50:58.531494 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-59676174-c090-408b-aa5f-085fee386e3d service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0739596 May 26 14:50:58.686988 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-e5b43347-f5e0-4754-8c65-a58114f766e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:58.688473 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-e5b43347-f5e0-4754-8c65-a58114f766e3 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=f2b58b2245f643ac9193934fdab405c5&device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 1099 time: 0.0706985 May 26 14:50:58.837236 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-6fd3591d-2c7b-4233-909f-7b95ab77648e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:58.838703 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-6fd3591d-2c7b-4233-909f-7b95ab77648e service neutron] 10.222.0.79 "GET /v2.0/networks?id=dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 200 len: 918 time: 0.1281090 May 26 14:50:58.943226 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-b35a3914-c97e-418a-bc00-e78483953756 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 200 len: 1001 time: 0.0976408 May 26 14:50:59.008883 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-aa57ef9f-aed1-425e-a0d6-46d03bd6ad48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:59.010406 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-aa57ef9f-aed1-425e-a0d6-46d03bd6ad48 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 200 len: 855 time: 0.0594709 May 26 14:50:59.193760 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-219004e1-7db6-44e2-9b74-e636b5dd77da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:50:59.195359 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-219004e1-7db6-44e2-9b74-e636b5dd77da service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=dcbc30ab-336e-46b8-a284-99efba24886a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1782186 May 26 14:50:59.330563 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-ae958822-712e-48a0-967a-de9828b27a8c service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1270335 May 26 14:50:59.465237 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-6fa5e4d3-59e4-4c54-a7b9-dae966af19f6 req-c5238ebd-204e-4f61-8602-49c5e0c431ff service neutron] 10.222.0.79 "GET /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273115 May 26 14:51:00.234478 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:51:02.261002 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47816) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:02.387123 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:02.402201 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:02.406516 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Usage tracker for resource:security_group_rule and tenant:b36b83da3d284074b43e4bc86b0c2ddf is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:02.409521 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:02.415816 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:02.501802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:02.507446 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:02.514525 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-697924e2-58a0-4f8a-8563-2b0c7d6415bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:02.554077 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=b36b83da3d284074b43e4bc86b0c2ddf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2919633 May 26 14:51:02.555095 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=987b3fdf-19d9-4e94-a719-b1b85f62adeb,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:02.557148 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47822) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:02.558399 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:02.616253 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-997583ed-4738-4ad7-b16d-cb2dd35a61e3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:02.646141 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-997583ed-4738-4ad7-b16d-cb2dd35a61e3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:02.703098 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-997583ed-4738-4ad7-b16d-cb2dd35a61e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:02.707102 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-efe9a9af-76b4-44e6-af42-dcb5a8627a8f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:02.719633 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-997583ed-4738-4ad7-b16d-cb2dd35a61e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=987b3fdf-19d9-4e94-a719-b1b85f62adeb,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:02.724622 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-997583ed-4738-4ad7-b16d-cb2dd35a61e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:02.728813 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-997583ed-4738-4ad7-b16d-cb2dd35a61e3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:02.729946 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-997583ed-4738-4ad7-b16d-cb2dd35a61e3 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/987b3fdf-19d9-4e94-a719-b1b85f62adeb HTTP/1.1" status: 204 len: 168 time: 0.1717834 May 26 14:51:03.031133 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47832) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:03.053284 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:03.067985 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:03.072185 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Usage tracker for resource:security_group_rule and tenant:6038fd37697844cb8c0b35d6ab713864 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:03.074976 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:03.081416 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:03.171198 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:03.177382 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:03.184596 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6c3aa28d-d585-4ac3-8daa-6848bafa9298 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:03.226818 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=6038fd37697844cb8c0b35d6ab713864&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1943514 May 26 14:51:03.227725 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40802397-90d8-475c-8f45-8e3acdc7518e,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:03.229089 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47840) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:03.231711 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:03.392761 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1681bfcb-8eeb-4db7-bf48-db7a057ce485 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:03.419327 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1681bfcb-8eeb-4db7-bf48-db7a057ce485 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:03.479064 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1681bfcb-8eeb-4db7-bf48-db7a057ce485 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:03.484232 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d27d6a21-7f10-4796-95f7-932d9bfd57b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:03.497872 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1681bfcb-8eeb-4db7-bf48-db7a057ce485 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40802397-90d8-475c-8f45-8e3acdc7518e,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:03.501248 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1681bfcb-8eeb-4db7-bf48-db7a057ce485 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:03.507287 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-1681bfcb-8eeb-4db7-bf48-db7a057ce485 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:03.511299 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-1681bfcb-8eeb-4db7-bf48-db7a057ce485 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/40802397-90d8-475c-8f45-8e3acdc7518e HTTP/1.1" status: 204 len: 168 time: 0.2801852 May 26 14:51:03.639616 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9387846-a986-4107-b572-ae9850dcb138 req-36f247d5-3c0e-4355-8efe-5cf28fffdee6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:03.641085 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e9387846-a986-4107-b572-ae9850dcb138 req-36f247d5-3c0e-4355-8efe-5cf28fffdee6 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 946 time: 0.0875828 May 26 14:51:03.691389 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e9387846-a986-4107-b572-ae9850dcb138 req-bf297055-1633-42e4-a5eb-2ffba3b84f52 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445642 May 26 14:51:04.880160 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a0ffdd-86a5-4a82-9d39-059f725e250e req-eff13fd9-2f59-42ff-8786-0a297375ae68 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:04.881754 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a8a0ffdd-86a5-4a82-9d39-059f725e250e req-eff13fd9-2f59-42ff-8786-0a297375ae68 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 946 time: 0.0799942 May 26 14:51:04.928350 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a8a0ffdd-86a5-4a82-9d39-059f725e250e req-69db33e5-b591-47c6-a3d5-f0a443eb1d44 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups?id=e8c42ca2-93cf-4598-951c-cdf06028ae80&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398262 May 26 14:51:05.098691 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-e80a857b-2f24-4a38-a6b8-bad391918356 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:05.099371 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-e80a857b-2f24-4a38-a6b8-bad391918356 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Synchronizing usage tracker for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:51:05.112052 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-e80a857b-2f24-4a38-a6b8-bad391918356 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Unset dirty status for tenant:f2b58b2245f643ac9193934fdab405c5 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:51:05.113257 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-e80a857b-2f24-4a38-a6b8-bad391918356 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 946 time: 0.1003096 May 26 14:51:05.255750 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Deleting port 210e790a-2172-4934-bf39-2d9aecd01a92 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:51:05.256146 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:05.394153 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] For port 210e790a-2172-4934-bf39-2d9aecd01a92, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=210e790a-2172-4934-bf39-2d9aecd01a92,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:05.394538 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:05.700874 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:05.701135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:05.701390 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Floating IP 2c320a0e-8f33-402c-bc7e-31008c534016 disassociated. External IP: 172.27.3.219, port: 210e790a-2172-4934-bf39-2d9aecd01a92. May 26 14:51:05.701717 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Calling delete_port for 210e790a-2172-4934-bf39-2d9aecd01a92 owned by compute:nova {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:51:05.824031 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:05.829753 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7795e2e3-52ca-4590-934b-d8aadbc3e797 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:05.876359 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event deleted for resources: {'Port': ['ID=210e790a-2172-4934-bf39-2d9aecd01a92,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:05.879474 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:06.069407 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Router f62ef884-b65a-487d-8955-15d95245398f has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:51:06.092256 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ed53cf5b-6ccf-411d-84c6-475160860ed0 req-be5565e1-dbde-4b1e-a12e-e2d26b09273e tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 210 time: 0.0503526 May 26 14:51:06.352018 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:51:06.361499 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] Sync routers for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:51:06.371514 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:06.372141 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:50:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:06.425820 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] No DVR routers for this DVR port 210e790a-2172-4934-bf39-2d9aecd01a92 on host hv-cinder-77459 {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:51:06.428423 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:06.431143 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-deleted', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:51:06.453977 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-7deefbe9-fd6e-4d00-a708-ca9c8b895b14 req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.79 "DELETE /v2.0/ports/210e790a-2172-4934-bf39-2d9aecd01a92 HTTP/1.1" status: 204 len: 173 time: 1.3347776 May 26 14:51:06.479293 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a', 'name': 'network-vif-deleted', 'tag': '210e790a-2172-4934-bf39-2d9aecd01a92', 'status': 'completed', 'code': 200} May 26 14:51:06.563056 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:06.880815 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:06.885316 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] Checking router: f62ef884-b65a-487d-8955-15d95245398f for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:51:06.893739 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:06.894386 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:50:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:07.072985 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:07.282184 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e18d152f-16fb-400c-879c-2cad4f3ae501 req-4e519962-d2a8-44c4-9c3c-fd1a34469d04 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/ports?device_id=c9ebd1dc-ca8a-4950-8fdc-47b4ba0e358a HTTP/1.1" status: 200 len: 210 time: 0.0449827 May 26 14:51:07.426505 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:07.431024 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d89f76-b4f8-4584-8962-011e2fcfdba2 None None] The sync data for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi is: [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:42:56Z', 'revision_number': 4, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'd2621169-995c-464e-b4f1-7f93fa23a183', 'name': '', 'network_id': 'dcbc30ab-336e-46b8-a284-99efba24886a', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'mac_address': 'fa:16:3e:e7:d6:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:51Z', 'updated_at': '2021-05-26T14:43:07Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'subnets': [{'id': '74523655-70dc-48f8-8616-d6b84cac2d6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:51:07.643964 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac27e9d2-4e9e-4206-b3de-f56b8d91802e None None] New status for floating IP 2c320a0e-8f33-402c-bc7e-31008c534016: DOWN {{(pid=98446) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:51:07.841731 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:51:07.883047 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 210e790a-2172-4934-bf39-2d9aecd01a92 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:51:07.883390 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 210e790a-2172-4934-bf39-2d9aecd01a92 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:51:08.413317 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47928) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:08.479525 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ac9b0ed2-8957-42a3-a496-f5bfcfbf647f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:08.512615 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ac9b0ed2-8957-42a3-a496-f5bfcfbf647f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:08.573290 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ac9b0ed2-8957-42a3-a496-f5bfcfbf647f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:08.577789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7614f0ef-160b-40ff-876f-416ce7fbbc1e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:08.592096 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac9b0ed2-8957-42a3-a496-f5bfcfbf647f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8c42ca2-93cf-4598-951c-cdf06028ae80,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:08.594579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ac9b0ed2-8957-42a3-a496-f5bfcfbf647f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:08.606866 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ac9b0ed2-8957-42a3-a496-f5bfcfbf647f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:08.608003 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-ac9b0ed2-8957-42a3-a496-f5bfcfbf647f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "DELETE /v2.0/security-groups/e8c42ca2-93cf-4598-951c-cdf06028ae80 HTTP/1.1" status: 204 len: 168 time: 0.1935017 May 26 14:51:08.610884 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47936) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:08.627988 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.api.v2.resource [None req-0b1d97fe-8659-4112-b75a-511f0439fbf1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] show failed (client error): The resource could not be found. May 26 14:51:08.628944 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0b1d97fe-8659-4112-b75a-511f0439fbf1 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "GET /v2.0/security-groups/e8c42ca2-93cf-4598-951c-cdf06028ae80 HTTP/1.1" status: 404 len: 347 time: 0.0165160 May 26 14:51:08.631725 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47940) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:08.872992 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Deleting port 13857025-e968-40b6-ab0b-8298ae3b136c {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:51:08.873343 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:08.994408 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:08.994709 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:09.116307 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Calling delete_port for 13857025-e968-40b6-ab0b-8298ae3b136c owned by network:floatingip {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:51:09.230018 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:09.233812 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d1a27c05-f29a-4cac-872d-8fcdd9cc29c5 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:09.283271 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Pushing event deleted for resources: {'Port': ['ID=13857025-e968-40b6-ab0b-8298ae3b136c,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:09.321313 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.321686 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.322059 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.322457 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.322818 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.323168 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.323509 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.323856 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.324392 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.324759 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.325429 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.325774 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:09.328911 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:09.388341 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks [] for floatingip, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:09.404753 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:09.406172 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c7f96aed-b4ef-4009-90b2-ec4695442f8a tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] 10.222.0.72 "DELETE /v2.0/floatingips/2c320a0e-8f33-402c-bc7e-31008c534016 HTTP/1.1" status: 204 len: 168 time: 0.7735732 May 26 14:51:10.119148 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47962) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:10.239791 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:10.254882 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:10.259329 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Usage tracker for resource:security_group_rule and tenant:b80880caff7b4c329eed46e9e2ab8c57 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:10.262340 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:10.268735 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:10.356594 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:10.362757 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:10.373734 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-329ffb9c-0fa3-4ada-b01d-5fc107240ea3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:10.416769 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=b80880caff7b4c329eed46e9e2ab8c57&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2965584 May 26 14:51:10.417649 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e17b583-4b6d-4fa7-9b39-8d1789b502f0,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:10.420683 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47968) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:10.421158 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:10.485063 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-76b7cab4-d766-4b22-8537-f2839e7975f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:10.511315 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-76b7cab4-d766-4b22-8537-f2839e7975f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:10.572699 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-76b7cab4-d766-4b22-8537-f2839e7975f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:10.576937 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1681bfcb-8eeb-4db7-bf48-db7a057ce485 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:10.591214 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b7cab4-d766-4b22-8537-f2839e7975f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e17b583-4b6d-4fa7-9b39-8d1789b502f0,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:10.595726 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-76b7cab4-d766-4b22-8537-f2839e7975f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:10.597744 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-76b7cab4-d766-4b22-8537-f2839e7975f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:10.598805 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-76b7cab4-d766-4b22-8537-f2839e7975f8 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/9e17b583-4b6d-4fa7-9b39-8d1789b502f0 HTTP/1.1" status: 204 len: 168 time: 0.1769812 May 26 14:51:10.889386 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 47984) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:10.907061 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:10.921764 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:10.925769 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Usage tracker for resource:security_group_rule and tenant:84864e0aab7e47b695aebae99d046c25 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:10.928729 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:10.934529 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:11.020380 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:11.025005 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:11.031983 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-acfdaef9-0afd-48e6-9e42-b67cefa3e2b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:11.072613 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=84864e0aab7e47b695aebae99d046c25&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1821091 May 26 14:51:11.073487 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4a87bd1-1a15-4a2c-bc68-c2fac76a48cd,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:11.076544 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 47990) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:11.077123 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5928be51-edd5-4a55-814a-3db313a46e21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:11.140609 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-36b22780-80e0-444b-9d6f-14efad7c9841 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:11.168650 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-36b22780-80e0-444b-9d6f-14efad7c9841 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:11.225521 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-36b22780-80e0-444b-9d6f-14efad7c9841 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:11.229580 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-611f49a4-0b2c-4f8e-b411-8079b3fe92fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:11.242151 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b22780-80e0-444b-9d6f-14efad7c9841 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4a87bd1-1a15-4a2c-bc68-c2fac76a48cd,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:11.245982 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-36b22780-80e0-444b-9d6f-14efad7c9841 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:11.252346 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-36b22780-80e0-444b-9d6f-14efad7c9841 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:11.253645 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-36b22780-80e0-444b-9d6f-14efad7c9841 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/e4a87bd1-1a15-4a2c-bc68-c2fac76a48cd HTTP/1.1" status: 204 len: 168 time: 0.1754851 May 26 14:51:12.215552 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48028) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:12.876099 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:13.389784 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Deleting port d2621169-995c-464e-b4f1-7f93fa23a183 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:51:13.390501 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:13.515157 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] For port d2621169-995c-464e-b4f1-7f93fa23a183, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d2621169-995c-464e-b4f1-7f93fa23a183,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:13.515514 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:13.635365 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Calling delete_port for d2621169-995c-464e-b4f1-7f93fa23a183 owned by network:router_interface {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:51:13.787424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:13.791264 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:13.836420 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Pushing event deleted for resources: {'Port': ['ID=d2621169-995c-464e-b4f1-7f93fa23a183,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:13.839651 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:14.127092 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:14.489118 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Router f62ef884-b65a-487d-8955-15d95245398f has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:51:14.676769 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:51:14.685963 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] Sync routers for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:51:14.696490 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:14.697061 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] 10.222.0.72 "PUT /v2.0/routers/f62ef884-b65a-487d-8955-15d95245398f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4802876 May 26 14:51:14.697218 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:50:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:14.700237 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48072) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:14.877081 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:14.969187 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks [] for router, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:15.160936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:15.190415 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:51:13Z', 'revision_number': 5, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port': {'id': 'b46a2445-80ec-49e7-aadf-1bb3c6e9b455', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:f0:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f62ef884-b65a-487d-8955-15d95245398f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:42:44Z', 'updated_at': '2021-05-26T14:42:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:15.194499 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] Checking router: f62ef884-b65a-487d-8955-15d95245398f for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:51:15.203307 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] Routers {'f62ef884-b65a-487d-8955-15d95245398f'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:15.203910 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:50:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['f62ef884-b65a-487d-8955-15d95245398f'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:15.239361 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Deleting port b46a2445-80ec-49e7-aadf-1bb3c6e9b455 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:51:15.239700 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:15.354989 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] Set router f62ef884-b65a-487d-8955-15d95245398f gateway port host: None {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:15.372364 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] For port b46a2445-80ec-49e7-aadf-1bb3c6e9b455, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=b46a2445-80ec-49e7-aadf-1bb3c6e9b455,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:15.372722 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:15.459418 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:51:15Z', 'revision_number': 6, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:15.463646 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1c054c5-f836-4d68-b89c-b1164715daf1 None None] The sync data for ids ['f62ef884-b65a-487d-8955-15d95245398f'] in dv-cinder-774594-6-iscsi is: [{'id': 'f62ef884-b65a-487d-8955-15d95245398f', 'name': 'tempest-AttachVolumeShelveTestJSON-189466523-router', 'tenant_id': 'f2b58b2245f643ac9193934fdab405c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:42:42Z', 'updated_at': '2021-05-26T14:51:15Z', 'revision_number': 6, 'project_id': 'f2b58b2245f643ac9193934fdab405c5', 'gw_port_host': None}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:51:15.515285 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Calling delete_port for b46a2445-80ec-49e7-aadf-1bb3c6e9b455 owned by network:router_gateway {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:51:15.662726 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:15.666406 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-debf1e30-14dc-473e-93d9-fdf595d11100 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:15.709649 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Pushing event deleted for resources: {'Port': ['ID=b46a2445-80ec-49e7-aadf-1bb3c6e9b455,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:15.712859 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:15.803624 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:15.978815 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:15.981034 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.068447 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.068877 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Fanout notify agent at l3_agent the message router_deleted on router f62ef884-b65a-487d-8955-15d95245398f {{(pid=98444) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:51:16.083121 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.084340 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e56fa08a-c8b6-4515-a5c8-be7f471df25c admin admin] 10.222.0.72 "DELETE /v2.0/routers/f62ef884-b65a-487d-8955-15d95245398f HTTP/1.1" status: 204 len: 168 time: 1.3831773 May 26 14:51:16.087517 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48100) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:16.146394 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] Deleting subnet 74523655-70dc-48f8-8616-d6b84cac2d6d {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:51:16.149456 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.200555 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.291424 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.385153 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device b46a2445-80ec-49e7-aadf-1bb3c6e9b455 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:51:16.419665 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: b46a2445-80ec-49e7-aadf-1bb3c6e9b455 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:51:16.420007 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device b46a2445-80ec-49e7-aadf-1bb3c6e9b455 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:51:16.420631 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d2621169-995c-464e-b4f1-7f93fa23a183 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:51:16.456576 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: d2621169-995c-464e-b4f1-7f93fa23a183 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:51:16.456923 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d2621169-995c-464e-b4f1-7f93fa23a183 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:51:16.656973 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.660996 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:16.694623 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=74523655-70dc-48f8-8616-d6b84cac2d6d,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:16.699343 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:16.700736 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.709973 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f2a14f75-c465-4574-9562-d7bb92ce9220 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/74523655-70dc-48f8-8616-d6b84cac2d6d HTTP/1.1" status: 204 len: 168 time: 0.6190329 May 26 14:51:16.710662 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48110) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:16.717204 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6488cebb-0981-4e74-b033-cc4075170588 None None] Network dcbc30ab-336e-46b8-a284-99efba24886a requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:51:16.820094 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.897595 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Deleting port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:51:16.897933 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:16.983958 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] DHCP port deletion for dcbc30ab-336e-46b8-a284-99efba24886a request from dv-cinder-774594-6-iscsi {{(pid=98446) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 26 14:51:17.000928 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] For port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:17.001306 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.016616 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48118) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:17.049187 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Deleting port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 {{(pid=98446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:51:17.049563 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.128145 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Calling delete_port for c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 owned by network:dhcp {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:51:17.149190 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.152547 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] For port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,segment=NetworkSegment(75b3edd7-3613-43c2-a8ac-684a11f6e11f),segment_id=75b3edd7-3613-43c2-a8ac-684a11f6e11f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:17.152999 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.184395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.188745 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0b530b8a-21d1-41ee-bf59-c299a8e6ff48 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:17.236582 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Pushing event deleted for resources: {'Port': ['ID=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:17.239854 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:17.240655 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] No DVR routers for this DVR port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 on host dv-cinder-774594-6-iscsi {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:51:17.277456 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Calling delete_port for c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 owned by network:dhcp {{(pid=98446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:51:17.284478 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:17.288326 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Usage tracker for resource:security_group_rule and tenant:d3001efb56ce4e7db3ba4155cc93a8d8 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:17.291332 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:17.297173 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:17.322719 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933'] for port, after_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.329063 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-f990d6c1-40cf-45a6-a0e5-faac5ce0d37e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:17.379714 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.382902 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.387891 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.397948 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ed41ffae-6d89-457b-88f4-65a889315a5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:17.398544 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dcbc30ab-336e-46b8-a284-99efba24886a']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:17.411651 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75b3edd7-3613-43c2-a8ac-684a11f6e11f') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:17.411935 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75b3edd7-3613-43c2-a8ac-684a11f6e11f') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:17.413134 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Pushing event deleted for resources: {'Port': ['ID=c00b3d7e-6f66-4f33-8706-fcd66f08b8e4,revision_number=None']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:17.415618 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] No DVR routers for this DVR port c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 on host dv-cinder-774594-6-iscsi {{(pid=98446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:51:17.424373 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.428676 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.429271 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.429814 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.429950 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a7435df4-7ba4-43df-ae26-4d0dff634c1c,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:17.430436 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.431029 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.431767 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.432101 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.432576 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.433092 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.434095 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.434662 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.435144 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:17.438782 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:17.442588 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.452672 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Releasing vlan 1101 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:51:17.453061 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.456892 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:17.460311 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d3001efb56ce4e7db3ba4155cc93a8d8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4423714 May 26 14:51:17.463170 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48124) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:51:17.466509 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:51:17.521039 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b78cce1a-fc7e-404c-8aac-162aa98fe714 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.549232 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b78cce1a-fc7e-404c-8aac-162aa98fe714 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.550584 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.554386 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:17.567738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.578243 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Pushing event deleted for resources: {'Network': ['ID=dcbc30ab-336e-46b8-a284-99efba24886a,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:17.581400 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:17.592589 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] 10.222.0.72 "DELETE /v2.0/networks/dcbc30ab-336e-46b8-a284-99efba24886a HTTP/1.1" status: 204 len: 168 time: 0.8813012 May 26 14:51:17.608989 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b78cce1a-fc7e-404c-8aac-162aa98fe714 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.614909 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-76b7cab4-d766-4b22-8537-f2839e7975f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:17.627841 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b78cce1a-fc7e-404c-8aac-162aa98fe714 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7435df4-7ba4-43df-ae26-4d0dff634c1c,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:17.630547 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b78cce1a-fc7e-404c-8aac-162aa98fe714 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:17.631716 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b78cce1a-fc7e-404c-8aac-162aa98fe714 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.634534 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-b78cce1a-fc7e-404c-8aac-162aa98fe714 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a7435df4-7ba4-43df-ae26-4d0dff634c1c HTTP/1.1" status: 204 len: 168 time: 0.1687505 May 26 14:51:17.716277 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48132) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:17.766455 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-f87714be-f4fe-4127-964a-ee47d7e1ea33 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f2b58b2245f643ac9193934fdab405c5&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0488908 May 26 14:51:17.768918 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48138) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:17.826138 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2aef724d-163a-47ef-972e-f8020449ba9b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.851681 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2aef724d-163a-47ef-972e-f8020449ba9b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.905716 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2aef724d-163a-47ef-972e-f8020449ba9b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.910505 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:17.923867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aef724d-163a-47ef-972e-f8020449ba9b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0693f589-ba60-4fe9-96d3-11b4d5fa2efd,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:17.927927 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-2aef724d-163a-47ef-972e-f8020449ba9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:17.929485 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48142) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:17.935668 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-2aef724d-163a-47ef-972e-f8020449ba9b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.939243 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-2aef724d-163a-47ef-972e-f8020449ba9b admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/0693f589-ba60-4fe9-96d3-11b4d5fa2efd HTTP/1.1" status: 204 len: 168 time: 0.1671109 May 26 14:51:17.951943 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:17.966994 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:17.971059 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Usage tracker for resource:security_group_rule and tenant:a889a233a80a46c7935d509f611119c6 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:17.973952 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:17.982813 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:18.069736 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.075278 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.087902 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-aed8c04f-9448-4e50-8281-08c13f626875 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:18.128083 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75ab9991-0f3d-4c39-afd9-b3bd035201be,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:18.135091 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=a889a233a80a46c7935d509f611119c6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2020936 May 26 14:51:18.135091 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:18.135391 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48148) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:18.200206 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2d1e8ca0-157a-4012-978a-9d0e37525c71 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.226772 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2d1e8ca0-157a-4012-978a-9d0e37525c71 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.281480 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2d1e8ca0-157a-4012-978a-9d0e37525c71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.285448 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b5dfd62f-4c61-4c1b-997f-24c3edcca8db admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:18.298535 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d1e8ca0-157a-4012-978a-9d0e37525c71 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75ab9991-0f3d-4c39-afd9-b3bd035201be,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:18.301490 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2d1e8ca0-157a-4012-978a-9d0e37525c71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:18.303579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2d1e8ca0-157a-4012-978a-9d0e37525c71 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.307026 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-2d1e8ca0-157a-4012-978a-9d0e37525c71 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/75ab9991-0f3d-4c39-afd9-b3bd035201be HTTP/1.1" status: 204 len: 168 time: 0.1684258 May 26 14:51:18.388039 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:51:18.427509 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:51:18.428145 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device c00b3d7e-6f66-4f33-8706-fcd66f08b8e4 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:51:18.609447 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48172) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:18.627197 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.641268 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:18.645103 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Usage tracker for resource:security_group_rule and tenant:e7d60a2c8bd14e2395211f981c89fd20 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:18.647772 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:18.653710 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:18.740861 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.746087 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.754585 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fd0b2cd7-a7b9-41f0-b857-8a9b4f606922 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:18.793760 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=e7d60a2c8bd14e2395211f981c89fd20&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1831145 May 26 14:51:18.795449 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a3f8a419-61af-46ba-b5d4-c2bad3cff973,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:18.796489 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48178) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:18.798431 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-174d4ad5-dd2b-4ef9-80a5-0026ae893d98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:18.861685 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b8e3b8cc-8bff-4a01-beb7-a5e14b695315 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.887308 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b8e3b8cc-8bff-4a01-beb7-a5e14b695315 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.940071 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b8e3b8cc-8bff-4a01-beb7-a5e14b695315 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.944333 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c0de1bb8-fa12-443e-9c71-3d49b5370f89 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:18.959722 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e3b8cc-8bff-4a01-beb7-a5e14b695315 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a3f8a419-61af-46ba-b5d4-c2bad3cff973,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:18.963799 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b8e3b8cc-8bff-4a01-beb7-a5e14b695315 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:18.967675 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b8e3b8cc-8bff-4a01-beb7-a5e14b695315 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:18.971624 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-b8e3b8cc-8bff-4a01-beb7-a5e14b695315 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/a3f8a419-61af-46ba-b5d4-c2bad3cff973 HTTP/1.1" status: 204 len: 168 time: 0.1713820 May 26 14:51:19.821307 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48222) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:19.931304 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1170764644-network', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:19.936132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:19.940075 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Usage tracker for resource:network and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:19.943179 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:19.948923 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:19.959619 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Made reservation on behalf of 28b9778de23c484bb66e4ac1f5aeb2c5 for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:51:19.962317 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:19.974421 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:19.988594 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:19.992412 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Usage tracker for resource:security_group_rule and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:19.995380 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:20.000519 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48230) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:20.002930 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:20.092654 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.097149 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.101324 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-6c34a64c-d9b7-4d89-8b98-2a57131f2566 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:20.149057 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.157805 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1145} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:51:20.169475 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2ad0c76-6d6b-4351-9889-0cc71f824d9f,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:20.174834 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:20.178130 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.178465 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Added segment c4a96841-5ad1-4e7d-bd36-df760e1caf70 of type vlan for network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 May 26 14:51:20.179833 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:20.187479 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Usage tracker for resource:security_group_rule and tenant:dde575f356e74d738c54a6ea0376a61d is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:20.191209 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:20.201328 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:20.221621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.276121 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.278359 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:20.278988 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.285395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:20.513458 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Pushing event updated for resources: {'Network': ['ID=4950f4fb-5f1e-4749-92f0-4580bd8b7f80,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:20.520579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:20.523861 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:51:20.526040 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.531165 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.7059109 May 26 14:51:20.531365 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48236) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:20.537343 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Request body: {'subnet': {'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1170764644-subnet', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'ip_version': 4}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:20.541662 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.549200 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:20.552689 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fddaa9f9-064d-4969-a356-25f59008e0d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:20.565456 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Usage tracker for resource:subnet and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:20.576403 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:20.588608 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:20.605020 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=dde575f356e74d738c54a6ea0376a61d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6034684 May 26 14:51:20.608267 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48240) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:20.608744 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67032336-a0c9-490e-a0e1-48f5981f7b4a,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:20.612460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:20.617460 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Made reservation on behalf of 28b9778de23c484bb66e4ac1f5aeb2c5 for: {'subnet': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:51:20.619901 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3135806'] for subnet, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.679591 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6e4fc0a5-ab95-472d-9bdb-dae7608ec3fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.705896 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6e4fc0a5-ab95-472d-9bdb-dae7608ec3fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.760237 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6e4fc0a5-ab95-472d-9bdb-dae7608ec3fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.765785 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ba88e480-1e4d-4835-9c36-7958f4a6d75d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:20.781814 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e4fc0a5-ab95-472d-9bdb-dae7608ec3fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67032336-a0c9-490e-a0e1-48f5981f7b4a,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:20.784154 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0a5-ab95-472d-9bdb-dae7608ec3fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:20.786523 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-6e4fc0a5-ab95-472d-9bdb-dae7608ec3fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:20.787595 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6e4fc0a5-ab95-472d-9bdb-dae7608ec3fd admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/67032336-a0c9-490e-a0e1-48f5981f7b4a HTTP/1.1" status: 204 len: 168 time: 0.1776373 May 26 14:51:21.016090 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3085630', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3135784'] for subnet, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.020783 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:21.076939 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48248) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:21.092129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=acf544a2-b701-4da7-82b8-dbc54487e21b,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:21.096092 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:21.099619 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.100099 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Checking segment: {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:21.100449 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Network hostable DHCP agents. Network: 4950f4fb-5f1e-4749-92f0-4580bd8b7f80, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98444) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:51:21.115045 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:21.117980 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98444) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:51:21.119475 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Usage tracker for resource:security_group_rule and tenant:097011564dca414e8bc19c31c51db885 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:21.122484 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:21.127765 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 4950f4fb-5f1e-4749-92f0-4580bd8b7f80) {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:21.129089 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:21.137099 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:21.137653 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.138924 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b539baa8-889c-462d-97ca-6a17ccd3fc88 None None] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:51:21.164212 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a0c17a69-bb18-4f4e-b7d2-dc471c6fdbf1 admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6314199 May 26 14:51:21.166556 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48252) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:21.172712 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:21.177702 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:21.181982 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Usage tracker for resource:router and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:21.185265 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:21.191854 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:21.204005 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.205031 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.222640 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.231644 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.236404 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.245923 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-2aef724d-163a-47ef-972e-f8020449ba9b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:21.286644 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=097011564dca414e8bc19c31c51db885&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2082722 May 26 14:51:21.288550 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e80cc27-9092-4536-88e3-bcdcfe8bb5f8,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:21.292164 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9cd33b59-4e4f-4fb1-ae6c-6d0993875f78 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:21.292344 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48256) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:21.365359 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:51:21.366603 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.523535 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Allocated IP 172.20.0.2 (4950f4fb-5f1e-4749-92f0-4580bd8b7f80/acf544a2-b701-4da7-82b8-dbc54487e21b/4ed33cd7-673c-4518-b4cf-e0f776a833fb) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:51:21.523824 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.544811 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-13d3f75e-e1b3-4fe8-958c-fca1ac2a4b76 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.588230 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-13d3f75e-e1b3-4fe8-958c-fca1ac2a4b76 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.652839 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c20e4164-0e7b-4494-b383-c9ff7ef750fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.711814 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-13d3f75e-e1b3-4fe8-958c-fca1ac2a4b76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.715909 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-32f93360-2ecb-4d94-84c7-280bafd02590 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:21.733643 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d3f75e-e1b3-4fe8-958c-fca1ac2a4b76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e80cc27-9092-4536-88e3-bcdcfe8bb5f8,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:21.736851 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-13d3f75e-e1b3-4fe8-958c-fca1ac2a4b76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:21.744228 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-13d3f75e-e1b3-4fe8-958c-fca1ac2a4b76 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.745341 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-13d3f75e-e1b3-4fe8-958c-fca1ac2a4b76 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/7e80cc27-9092-4536-88e3-bcdcfe8bb5f8 HTTP/1.1" status: 204 len: 168 time: 0.4470255 May 26 14:51:21.755475 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.768523 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Transition to ACTIVE for port object 4ed33cd7-673c-4518-b4cf-e0f776a833fb will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:21.790892 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Transition to ACTIVE for port object 4ed33cd7-673c-4518-b4cf-e0f776a833fb will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:21.797883 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.802729 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:21.865707 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:21.868756 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:21.871496 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:51:21.910749 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Pushing event updated for resources: {'Port': ['ID=4ed33cd7-673c-4518-b4cf-e0f776a833fb,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:21.914295 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:21.927987 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.963556 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.970488 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Attempting to bind port 4ed33cd7-673c-4518-b4cf-e0f776a833fb on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:51:21.970934 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Attempting to bind port 4ed33cd7-673c-4518-b4cf-e0f776a833fb by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:51:21.971267 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Attempting to bind port 4ed33cd7-673c-4518-b4cf-e0f776a833fb on network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:51:21.976738 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 50, 55), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:51:21.977113 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Checking segment: {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:21.977511 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:21.977896 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Bound using segment: {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:51:21.978396 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Bound port: 4ed33cd7-673c-4518-b4cf-e0f776a833fb, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:51:21.978763 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:22.077488 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] For port 4ed33cd7-673c-4518-b4cf-e0f776a833fb, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:51:22.080890 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] For port 4ed33cd7-673c-4518-b4cf-e0f776a833fb, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=4ed33cd7-673c-4518-b4cf-e0f776a833fb,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:51:22.085875 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:22.090728 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2654e2d-62c8-480e-9028-efc33ec849e3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:22.103729 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Allocated IP 172.27.3.228 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/a8f4a817-f312-4eac-a9c1-20e18933f65a) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:51:22.176183 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Pushing event updated for resources: {'Port': ['ID=4ed33cd7-673c-4518-b4cf-e0f776a833fb,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:22.179628 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:22.416077 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:22.451868 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:22.457417 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9ff8d4c8-8844-4731-93da-1add4135c189 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:22.521735 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:22.525104 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:22.529896 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:51:22.566081 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Pushing event updated for resources: {'Port': ['ID=a8f4a817-f312-4eac-a9c1-20e18933f65a,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:22.570571 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:22.965947 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:23.091308 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a4aaf21-193e-441d-a0d3-9e032d516d63 None None] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:51:23.203685 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-c7baefb9-f152-419a-96b9-98f0e9f9f979 None None] Provisioning for port 4ed33cd7-673c-4518-b4cf-e0f776a833fb completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:23.290434 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-4cf90405-d93d-4e5d-a3ae-b7866ec460cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:23.317934 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:23.539773 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Router 4a536108-40a6-42ed-a3fe-5ad5763534db is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98444) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:51:23.834596 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:51:23.844589 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Sync routers for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:51:23.857831 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:23.858966 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:23.859616 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.6917994 May 26 14:51:23.860111 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:23.862067 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48308) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:24.086689 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:24.381202 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:22Z', 'revision_number': 3, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:24.387276 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Checking router: 4a536108-40a6-42ed-a3fe-5ad5763534db for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:51:24.387828 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Updating router 4a536108-40a6-42ed-a3fe-5ad5763534db port a8f4a817-f312-4eac-a9c1-20e18933f65a binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:51:24.429345 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 4ed33cd7-673c-4518-b4cf-e0f776a833fb up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:24.495105 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:24.574226 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:24.610974 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 4ed33cd7-673c-4518-b4cf-e0f776a833fb completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:24.627434 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 4ed33cd7-673c-4518-b4cf-e0f776a833fb triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:24.627812 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:24.657721 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:24.781427 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Allocated IP 172.20.0.1 (4950f4fb-5f1e-4749-92f0-4580bd8b7f80/acf544a2-b701-4da7-82b8-dbc54487e21b/f89ba2e3-b9cb-4e0e-bc3e-527426130f29) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:51:24.863698 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:24.930234 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:24.944686 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 4ed33cd7-673c-4518-b4cf-e0f776a833fb, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=4ed33cd7-673c-4518-b4cf-e0f776a833fb,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:24.950900 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Transition to ACTIVE for port object f89ba2e3-b9cb-4e0e-bc3e-527426130f29 will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:24.957835 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:24.961599 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:24.982697 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:24.988184 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:25.023588 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.043735 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Transition to ACTIVE for port object a8f4a817-f312-4eac-a9c1-20e18933f65a will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:25.051574 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=4ed33cd7-673c-4518-b4cf-e0f776a833fb,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:25.054937 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:25.055790 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.060545 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:25.068066 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Pushing event updated for resources: {'Port': ['ID=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:25.077761 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:25.088528 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:25.089917 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:25.092683 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:51:25.134943 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Attempting to bind port a8f4a817-f312-4eac-a9c1-20e18933f65a on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:51:25.135339 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Attempting to bind port a8f4a817-f312-4eac-a9c1-20e18933f65a by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:51:25.135709 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Attempting to bind port a8f4a817-f312-4eac-a9c1-20e18933f65a on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:51:25.141751 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f58817-6cd1-429f-bdb9-473c27235da9 None None] Pushing event updated for resources: {'Port': ['ID=a8f4a817-f312-4eac-a9c1-20e18933f65a,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:25.146090 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-60f58817-6cd1-429f-bdb9-473c27235da9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:25.146790 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 51, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:51:25.147163 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:25.147589 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.148014 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:51:25.148493 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Bound port: a8f4a817-f312-4eac-a9c1-20e18933f65a, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:51:25.148875 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.157757 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.237733 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] For port a8f4a817-f312-4eac-a9c1-20e18933f65a, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:51:25.241552 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] For port a8f4a817-f312-4eac-a9c1-20e18933f65a, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a8f4a817-f312-4eac-a9c1-20e18933f65a,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:51:25.249943 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.260811 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-7acee3ea-c005-4b6c-893f-a600ea47403e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:25.343623 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:25.344281 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:25.461798 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f58817-6cd1-429f-bdb9-473c27235da9 None None] Pushing event updated for resources: {'Port': ['ID=a8f4a817-f312-4eac-a9c1-20e18933f65a,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:25.515469 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8477dd41-5290-4bcb-a602-1267712ddff5 None None] Provisioning for port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:25.526508 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-60f58817-6cd1-429f-bdb9-473c27235da9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:25.536078 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8477dd41-5290-4bcb-a602-1267712ddff5 None None] Provisioning complete for port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:25.536472 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8477dd41-5290-4bcb-a602-1267712ddff5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.573607 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.608143 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8477dd41-5290-4bcb-a602-1267712ddff5 None None] Port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:51:25.610747 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:25.805400 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.810703 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.838185 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:25.921294 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.926338 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Pushing event updated for resources: {'Port': ['ID=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:25.929426 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:25.942534 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.950045 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:25.973255 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:22Z', 'revision_number': 3, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:25.978518 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecac3bfd-6a90-4f9a-9ab2-6a73a38f2d01 None None] The sync data for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi is: [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:22Z', 'revision_number': 3, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:51:26.083473 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:26.085082 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:26.319526 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Router 4a536108-40a6-42ed-a3fe-5ad5763534db has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:51:26.342075 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-e8f13660-f746-46f6-9252-d8650d736118 None None] Provisioning complete for port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:26.342706 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e8f13660-f746-46f6-9252-d8650d736118 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:26.424434 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-e8f13660-f746-46f6-9252-d8650d736118 None None] Port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:51:26.511243 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a8f4a817-f312-4eac-a9c1-20e18933f65a up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:26.533047 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:51:26.555488 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] 10.222.0.72 "PUT /v2.0/routers/4a536108-40a6-42ed-a3fe-5ad5763534db/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6823781 May 26 14:51:26.586703 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port a8f4a817-f312-4eac-a9c1-20e18933f65a completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:26.592451 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port a8f4a817-f312-4eac-a9c1-20e18933f65a triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:26.592745 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:26.718446 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:26.735986 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port a8f4a817-f312-4eac-a9c1-20e18933f65a, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a8f4a817-f312-4eac-a9c1-20e18933f65a,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:26.741924 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:26.742557 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 4ed33cd7-673c-4518-b4cf-e0f776a833fb up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:26.771147 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:26.866319 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=a8f4a817-f312-4eac-a9c1-20e18933f65a,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:26.870039 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:26.875487 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 4ed33cd7-673c-4518-b4cf-e0f776a833fb triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:26.875824 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.173125 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48348) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:27.179189 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-903443205-network', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:27.184035 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:27.188171 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Usage tracker for resource:network and tenant:78915a8765bc4d5cb1781cbe6eebe45d is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:27.191071 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:27.197117 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:27.208793 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Made reservation on behalf of 78915a8765bc4d5cb1781cbe6eebe45d for: {'network': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:51:27.211494 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7757627'] for network, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.223680 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.239349 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:27.243495 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Usage tracker for resource:security_group_rule and tenant:78915a8765bc4d5cb1781cbe6eebe45d is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:27.246527 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:27.253428 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:27.372702 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.377178 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.380263 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-322e29f6-1b3a-4d70-9a31-64de3bc219d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:27.408741 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1126} {{(pid=98444) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 26 14:51:27.417469 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34e59287-f75d-4a68-9233-b4d1b23805f3,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:27.421170 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:27.423842 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.424180 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.segments_db [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Added segment b8e926a3-ea56-493c-bb6a-a41b3652bb24 of type vlan for network 03f468fb-31b1-4cd2-9057-202c8933354e May 26 14:51:27.453154 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750109882206'] for network, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.490942 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723'] for network, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.493067 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:27.493740 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.499244 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:27.500455 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.600747 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] 10.222.0.72 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4264398 May 26 14:51:27.601815 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Pushing event updated for resources: {'Network': ['ID=03f468fb-31b1-4cd2-9057-202c8933354e,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:27.604255 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48356) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:27.604771 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-dc837a3c-0f2f-4700-8545-be04d2ef2aa0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:27.610643 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Request body: {'subnet': {'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-903443205-subnet', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'ip_version': 4}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:27.613709 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Network 03f468fb-31b1-4cd2-9057-202c8933354e details requested by agent ovs-agent-dv-cinder-774594-6-iscsi with host dv-cinder-774594-6-iscsi {{(pid=98446) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 26 14:51:27.615729 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:27.619808 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Usage tracker for resource:subnet and tenant:78915a8765bc4d5cb1781cbe6eebe45d is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:27.622699 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:27.628719 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:27.646863 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Made reservation on behalf of 78915a8765bc4d5cb1781cbe6eebe45d for: {'subnet': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:51:27.647244 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2577413'] for subnet, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.655593 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48360) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:27.692629 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Sync routers for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:51:27.708232 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:27.709605 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:27.792927 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.811884 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:27.815716 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Usage tracker for resource:security_group_rule and tenant:99ec38be03f343b1b21002b741722c0d is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:27.818537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:27.824250 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:27.900115 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:27.910857 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.916224 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:27.926338 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-13d3f75e-e1b3-4fe8-958c-fca1ac2a4b76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:27.965399 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bbc935c-2f1c-4227-97c5-e3f9b392908d,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:27.970593 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:27.974870 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-48e705ae-1b2f-49fe-ae82-9b795be7a1e5 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=99ec38be03f343b1b21002b741722c0d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3182209 May 26 14:51:27.977453 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48366) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:28.036114 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c8509194-842e-4922-a82d-1d2e8e75692f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.063658 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c8509194-842e-4922-a82d-1d2e8e75692f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.067314 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2332857', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2577427'] for subnet, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.072378 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b8390d45-c3d9-4edb-99e2-8691cbf2a89d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:28.124907 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c8509194-842e-4922-a82d-1d2e8e75692f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.130416 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e745f1b8-fdb9-4b4e-a138-e95ce9e24bd0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:28.145043 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8509194-842e-4922-a82d-1d2e8e75692f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bbc935c-2f1c-4227-97c5-e3f9b392908d,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:28.151478 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c8509194-842e-4922-a82d-1d2e8e75692f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:28.152863 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c8509194-842e-4922-a82d-1d2e8e75692f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.153982 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c8509194-842e-4922-a82d-1d2e8e75692f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/7bbc935c-2f1c-4227-97c5-e3f9b392908d HTTP/1.1" status: 204 len: 168 time: 0.1756346 May 26 14:51:28.156473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Pushing event updated for resources: {'Subnet': ['ID=a62bd878-2032-417d-a192-a8107571412e,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:28.160755 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:28.164996 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Checking segment: {'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:28.165409 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Network hostable DHCP agents. Network: 03f468fb-31b1-4cd2-9057-202c8933354e, hostable agents: ['d95c823b-3594-49ee-a655-84e98c364d68'], hosted agents: [] {{(pid=98445) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 26 14:51:28.187655 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Network 03f468fb-31b1-4cd2-9057-202c8933354e is scheduled to be hosted by DHCP agent d95c823b-3594-49ee-a655-84e98c364d68 with binding_index 1 {{(pid=98445) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 26 14:51:28.199009 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-774594-6-iscsi, 03f468fb-31b1-4cd2-9057-202c8933354e) {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:28.209532 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8853146e-515c-479d-9595-4f30d2e03f79 None None] Network 03f468fb-31b1-4cd2-9057-202c8933354e requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:51:28.209718 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:28.210251 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for subnet, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.243559 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-7a19965d-ad10-46b0-9cc8-cf0de1dee3af admin admin] 10.222.0.72 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.6379275 May 26 14:51:28.245881 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48372) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:28.252363 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:28.258007 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:28.264006 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Usage tracker for resource:router and tenant:78915a8765bc4d5cb1781cbe6eebe45d is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:28.267630 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:28.274707 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:28.282179 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 2, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:28.288223 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Checking router: 4a536108-40a6-42ed-a3fe-5ad5763534db for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:51:28.288826 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Updating router 4a536108-40a6-42ed-a3fe-5ad5763534db port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:51:28.290791 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415918', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7854'] for router, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.291812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-415150', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-417894', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-488368', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7895'] for router, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.314016 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.378673 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.458419 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a8f4a817-f312-4eac-a9c1-20e18933f65a up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:28.515308 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp83f1982f-0d51-5e77-9ebb-fe786304bde2-03f468fb-31b1-4cd2-9057-202c8933354e', 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'fixed_ips': [{'subnet_id': 'a62bd878-2032-417d-a192-a8107571412e'}]}} from dv-cinder-774594-6-iscsi. {{(pid=98446) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 26 14:51:28.516163 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.539273 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48378) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:28.559831 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.575583 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:28.579515 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Usage tracker for resource:security_group_rule and tenant:e2f9799366024207ae9239685a9ec16d is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:28.582466 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:28.589135 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:28.627294 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port a8f4a817-f312-4eac-a9c1-20e18933f65a triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:28.627878 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.667389 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-417905', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415920', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7873'] for router, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.685970 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.692539 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.705648 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ac9b0ed2-8957-42a3-a496-f5bfcfbf647f tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:28.759006 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=e2f9799366024207ae9239685a9ec16d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2176418 May 26 14:51:28.759954 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cf4390a-2467-4294-9cf6-4e0ec1aceb65,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:28.761627 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48382) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:28.763826 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9651eb37-0751-497e-8189-1740f1603b4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:28.767260 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.780008 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Transition to ACTIVE for port object f89ba2e3-b9cb-4e0e-bc3e-527426130f29 will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:28.783395 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.db_base_plugin_common [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Allocated IP 172.20.0.2 (03f468fb-31b1-4cd2-9057-202c8933354e/a62bd878-2032-417d-a192-a8107571412e/8f18d374-788d-4f05-b422-816c9581e5e0) {{(pid=98446) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:51:28.788326 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.793048 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:28.947815 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Pushing event updated for resources: {'Port': ['ID=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:28.962673 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.963276 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.963929 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.964430 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.965228 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.965808 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.966324 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.966867 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.967423 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.967964 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.968483 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.969016 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98447) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:51:28.972778 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-87cfd116-4b5e-4faf-8850-bae6418ffb5a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:28.977895 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:29.008375 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-87cfd116-4b5e-4faf-8850-bae6418ffb5a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.030691 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Attempting to bind port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:51:29.031448 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Attempting to bind port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:51:29.032076 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Attempting to bind port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 on network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:51:29.039099 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 51, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:51:29.039790 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Checking segment: {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:29.040428 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.041602 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Bound using segment: {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:51:29.042887 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Bound port: f89ba2e3-b9cb-4e0e-bc3e-527426130f29, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:51:29.043516 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.124262 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Notify callbacks [] for port, precommit_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.139929 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] For port f89ba2e3-b9cb-4e0e-bc3e-527426130f29, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:51:29.143137 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] For port f89ba2e3-b9cb-4e0e-bc3e-527426130f29, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:51:29.146847 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.150646 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:29.205351 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Transition to ACTIVE for port object 8f18d374-788d-4f05-b422-816c9581e5e0 will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:29.221024 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Pushing event updated for resources: {'Port': ['ID=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,revision_number=4']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:29.225681 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-5ec3c8f5-f88a-45f8-9998-5bfb02846fe9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:29.229671 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-87cfd116-4b5e-4faf-8850-bae6418ffb5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.235599 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:29.236268 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:29.237785 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d00daafd-4897-4a8d-b2bb-8fa35ce837b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:29.239355 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Transition to ACTIVE for port object 8f18d374-788d-4f05-b422-816c9581e5e0 will not be triggered until provisioned by entity DHCP. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:29.247745 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924'] for port, after_create {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.253252 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:29.258416 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87cfd116-4b5e-4faf-8850-bae6418ffb5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cf4390a-2467-4294-9cf6-4e0ec1aceb65,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:29.262595 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-87cfd116-4b5e-4faf-8850-bae6418ffb5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:29.278165 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.312694 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-87cfd116-4b5e-4faf-8850-bae6418ffb5a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.313820 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-87cfd116-4b5e-4faf-8850-bae6418ffb5a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/0cf4390a-2467-4294-9cf6-4e0ec1aceb65 HTTP/1.1" status: 204 len: 168 time: 0.5511990 May 26 14:51:29.315118 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.344010 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Network 03f468fb-31b1-4cd2-9057-202c8933354e is already hosted by enough agents. {{(pid=98446) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:29.352634 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.scheduler.base_scheduler [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Resources bound (agent type, host, resource id): {{(pid=98446) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:29.355291 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Received port after_create {{(pid=98446) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:51:29.459208 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Pushing event updated for resources: {'Port': ['ID=8f18d374-788d-4f05-b422-816c9581e5e0,revision_number=1']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:29.488267 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:29.490222 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Attempting to bind port 8f18d374-788d-4f05-b422-816c9581e5e0 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:51:29.490619 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Attempting to bind port 8f18d374-788d-4f05-b422-816c9581e5e0 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:51:29.490983 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Attempting to bind port 8f18d374-788d-4f05-b422-816c9581e5e0 on network 03f468fb-31b1-4cd2-9057-202c8933354e {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:51:29.494850 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:29.499554 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 51, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:51:29.499850 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Allocated IP 172.27.3.201 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:51:29.499986 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Checking segment: {'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:29.500337 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.500723 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Bound using segment: {'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:51:29.501388 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Bound port: 8f18d374-788d-4f05-b422-816c9581e5e0, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:51:29.501586 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.603548 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] For port 8f18d374-788d-4f05-b422-816c9581e5e0, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:51:29.607016 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] For port 8f18d374-788d-4f05-b422-816c9581e5e0, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=8f18d374-788d-4f05-b422-816c9581e5e0,segment=NetworkSegment(b8e926a3-ea56-493c-bb6a-a41b3652bb24),segment_id=b8e926a3-ea56-493c-bb6a-a41b3652bb24)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:51:29.614739 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.623471 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:29.671486 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.705420 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Pushing event updated for resources: {'Port': ['ID=8f18d374-788d-4f05-b422-816c9581e5e0,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:29.708651 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-59120d82-9425-48c1-bb80-001d52d76d6a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:29.724225 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:29.728890 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:29.796135 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:29.800404 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:29.802959 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:51:29.836737 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Pushing event updated for resources: {'Port': ['ID=5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:29.842862 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:29.884144 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:29Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:29.890192 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-704e3c77-f145-4ac5-b47a-47e15d727fb3 None None] The sync data for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi is: [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:29Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:51:30.326418 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:30.503807 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device f89ba2e3-b9cb-4e0e-bc3e-527426130f29 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:30.615015 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:30.623776 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:30.624251 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:30.822621 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:30.873857 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port f89ba2e3-b9cb-4e0e-bc3e-527426130f29, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:30.881387 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:30.882509 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 8f18d374-788d-4f05-b422-816c9581e5e0 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:30.913891 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:30.942146 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4138d454-faf9-4e01-9025-a1e3ef7154ee None None] Network 03f468fb-31b1-4cd2-9057-202c8933354e requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:51:30.957205 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415929', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-417792'] for router, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:31.092616 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-9620b0f7-541f-4748-a69a-627930a35742 None None] Provisioning for port 8f18d374-788d-4f05-b422-816c9581e5e0 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:31.115094 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:31.119702 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:31.138187 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 8f18d374-788d-4f05-b422-816c9581e5e0 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:31.148147 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 8f18d374-788d-4f05-b422-816c9581e5e0 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:31.148808 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:31.214622 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Router 08aad9f4-39ef-41df-a92c-f8a161593b8b is scheduled to L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed with binding_index 1 {{(pid=98445) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 26 14:51:31.371797 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:31.415250 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:51:31.418274 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 8f18d374-788d-4f05-b422-816c9581e5e0, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=8f18d374-788d-4f05-b422-816c9581e5e0,segment=NetworkSegment(b8e926a3-ea56-493c-bb6a-a41b3652bb24),segment_id=b8e926a3-ea56-493c-bb6a-a41b3652bb24)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:31.425173 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Sync routers for ids ['08aad9f4-39ef-41df-a92c-f8a161593b8b'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:51:31.442685 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:31.445255 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:31.446430 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] Notify callbacks [] for router, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:31.452115 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-cea7d3ea-06b9-40f0-b53c-245395b745e9 admin admin] 10.222.0.72 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 3.2012606 May 26 14:51:31.452370 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48424) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:31.495221 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Routers {'08aad9f4-39ef-41df-a92c-f8a161593b8b'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:31.495855 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['08aad9f4-39ef-41df-a92c-f8a161593b8b'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:31.686882 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=8f18d374-788d-4f05-b422-816c9581e5e0,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:31.692373 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:31.717856 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Set router 08aad9f4-39ef-41df-a92c-f8a161593b8b gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:31.947876 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-3bcf1eb8-56cf-4e93-ae8a-fca27a47ea34 None None] Provisioning complete for port 8f18d374-788d-4f05-b422-816c9581e5e0 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:31.948440 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3bcf1eb8-56cf-4e93-ae8a-fca27a47ea34 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.177553 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201'}], 'enable_snat': True}, 'gw_port_id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:51:30Z', 'revision_number': 3, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port': {'id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:10:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:29Z', 'updated_at': '2021-05-26T14:51:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:32.181626 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Checking router: 08aad9f4-39ef-41df-a92c-f8a161593b8b for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:51:32.181974 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Updating router 08aad9f4-39ef-41df-a92c-f8a161593b8b port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f binding host dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:51:32.195517 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.237839 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.407283 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Allocated IP 172.20.0.1 (03f468fb-31b1-4cd2-9057-202c8933354e/a62bd878-2032-417d-a192-a8107571412e/f7927c93-7c71-4890-bf98-14084da6ec98) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:51:32.433285 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device f89ba2e3-b9cb-4e0e-bc3e-527426130f29 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:32.557133 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:32.557510 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.672427 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.684114 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Notify callbacks [] for port, precommit_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.688370 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Transition to ACTIVE for port object f7927c93-7c71-4890-bf98-14084da6ec98 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:32.711876 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.715528 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:32.733910 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Transition to ACTIVE for port object 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f will not be triggered until provisioned by entity L2. {{(pid=98446) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:32.751229 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.757654 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:32.781086 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Network 03f468fb-31b1-4cd2-9057-202c8933354e is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:32.783885 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:32.787291 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:51:32.797303 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 8f18d374-788d-4f05-b422-816c9581e5e0 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:32.816327 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Pushing event updated for resources: {'Port': ['ID=f7927c93-7c71-4890-bf98-14084da6ec98,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:32.822698 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:32.851242 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421734'] for router_interface, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.886474 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Attempting to bind port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:51:32.886846 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Attempting to bind port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:51:32.887213 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Attempting to bind port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f on network 9026b71b-9440-4cf5-9621-fcfdac3440f9 {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:51:32.889276 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-947fa5dc-2db4-4ed5-9e98-5bcc862d5725 None None] Pushing event updated for resources: {'Port': ['ID=5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f,revision_number=2']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:32.892208 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-947fa5dc-2db4-4ed5-9e98-5bcc862d5725 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:32.901816 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 51, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:51:32.902197 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Checking segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98446) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:32.902628 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.903026 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Bound using segment: {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'} {{(pid=98446) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:51:32.903502 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.managers [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Bound port: 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de92d977-7df2-4448-8678-5399b2199f0b', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9'}}] {{(pid=98446) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:51:32.903879 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:32.990521 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 8f18d374-788d-4f05-b422-816c9581e5e0 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:32.991235 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:33.030966 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] For port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98446) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:51:33.032865 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-d5b12c54-d1a3-42eb-aa9c-6c100ff162f9 None None] Provisioning for port f7927c93-7c71-4890-bf98-14084da6ec98 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:33.053377 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-d5b12c54-d1a3-42eb-aa9c-6c100ff162f9 None None] Provisioning complete for port f7927c93-7c71-4890-bf98-14084da6ec98 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:33.053747 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d5b12c54-d1a3-42eb-aa9c-6c100ff162f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:33.081166 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] For port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:51:33.097472 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:33.107728 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:33.116281 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:33.195859 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-d5b12c54-d1a3-42eb-aa9c-6c100ff162f9 None None] Port f7927c93-7c71-4890-bf98-14084da6ec98 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:51:33.234797 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Routers {'08aad9f4-39ef-41df-a92c-f8a161593b8b'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:33.235446 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['08aad9f4-39ef-41df-a92c-f8a161593b8b'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:33.354163 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:33.360161 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:33.367934 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-947fa5dc-2db4-4ed5-9e98-5bcc862d5725 None None] Pushing event updated for resources: {'Port': ['ID=5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f,revision_number=3']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:33.371160 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-947fa5dc-2db4-4ed5-9e98-5bcc862d5725 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:33.389539 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-33057b03-65d3-4e2f-896c-fc660ca59aa7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:33.472558 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-575737', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-421829'] for router_interface, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:33.477294 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Pushing event updated for resources: {'Port': ['ID=f7927c93-7c71-4890-bf98-14084da6ec98,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:33.481838 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:33.509006 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] Set router 08aad9f4-39ef-41df-a92c-f8a161593b8b gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:33.622177 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Network 03f468fb-31b1-4cd2-9057-202c8933354e is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:33.623369 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:33.812601 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Router 08aad9f4-39ef-41df-a92c-f8a161593b8b has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:51:33.833863 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-93a2cb23-f81a-4876-8a16-ba28fbb08b4b None None] Provisioning complete for port f7927c93-7c71-4890-bf98-14084da6ec98 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:33.834234 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-93a2cb23-f81a-4876-8a16-ba28fbb08b4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:33.894906 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-93a2cb23-f81a-4876-8a16-ba28fbb08b4b None None] Port f7927c93-7c71-4890-bf98-14084da6ec98 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:51:33.901938 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201'}], 'enable_snat': True}, 'gw_port_id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:51:33Z', 'revision_number': 4, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port': {'id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:10:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:29Z', 'updated_at': '2021-05-26T14:51:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f7927c93-7c71-4890-bf98-14084da6ec98', 'name': '', 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'mac_address': 'fa:16:3e:8b:fe:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'a62bd878-2032-417d-a192-a8107571412e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:32Z', 'updated_at': '2021-05-26T14:51:32Z', 'revision_number': 1, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'subnets': [{'id': 'a62bd878-2032-417d-a192-a8107571412e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:33.906696 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc79368e-d974-4993-8d5e-b1dee3cb2420 None None] The sync data for ids ['08aad9f4-39ef-41df-a92c-f8a161593b8b'] in dv-cinder-774594-6-iscsi is: [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201'}], 'enable_snat': True}, 'gw_port_id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:51:33Z', 'revision_number': 4, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port': {'id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:10:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:29Z', 'updated_at': '2021-05-26T14:51:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f7927c93-7c71-4890-bf98-14084da6ec98', 'name': '', 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'mac_address': 'fa:16:3e:8b:fe:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'a62bd878-2032-417d-a192-a8107571412e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:32Z', 'updated_at': '2021-05-26T14:51:32Z', 'revision_number': 1, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'subnets': [{'id': 'a62bd878-2032-417d-a192-a8107571412e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:51:33.999030 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:51:34.008013 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-081c6c0e-17fb-405f-901c-2bdd981ad2c6 admin admin] 10.222.0.72 "PUT /v2.0/routers/08aad9f4-39ef-41df-a92c-f8a161593b8b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5494006 May 26 14:51:34.586107 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48452) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:34.591710 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-971879507', 'description': 'tempest-secgroup-smoke-971879507 description', 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:34.597817 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:34.601950 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:security_group and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:34.604883 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:34.610768 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:34.629698 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:34.654706 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:34.658759 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:security_group_rule and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:34.662000 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:34.668375 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:34.751494 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:34.756249 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:34.761058 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:34.800836 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'SecurityGroup': ['ID=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:34.804138 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:34.805303 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:34.806891 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3c22d2fc-2d5a-4f65-9e4f-8321013ef07e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.2196863 May 26 14:51:34.810537 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48460) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:34.816178 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'security_group_rule': {'security_group_id': '10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3', 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:34.826545 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:34.830564 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:security_group_rule and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:34.833444 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:34.839895 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:34.860754 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:34.929184 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:34.933762 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:34.936242 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:34.964541 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=172caac5-b080-4d64-942f-eea449e36dff,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:34.967391 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:34.980624 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:34.984600 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1702926 May 26 14:51:34.985005 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48470) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:34.991884 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'security_group_rule': {'security_group_id': '10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3', 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:34.999159 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:35.003395 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:security_group_rule and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:35.006505 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:35.013067 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:35.036197 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.237053 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.245872 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.248304 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-fb73c9f7-3697-4475-9853-869948fadba9 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:35.271943 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2852565e-df09-48be-ac91-f124d8a993e1,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:35.274520 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:35.282511 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.283944 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-0411de92-d80d-41b1-b781-5245ac3c021d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2977624 May 26 14:51:35.286582 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48490) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:35.292145 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'security_group_rule': {'security_group_id': '10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3', 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:35.299162 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:35.303274 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:security_group_rule and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:35.306498 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:35.312250 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:35.329044 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.392810 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.397140 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.399391 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a4dd9ea0-bb36-4515-8fcc-58e7d1ffdc09 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:35.421267 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=20a607f4-1bbe-4c14-9816-91b526d39788,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:35.423689 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:35.431970 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.436095 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48500) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:35.436299 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-b6c53c6e-88df-4e96-ad48-1b7f7497a319 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1484663 May 26 14:51:35.441801 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'security_group_rule': {'security_group_id': '10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3', 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:35.448313 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:35.452859 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:security_group_rule and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:35.455752 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:35.461697 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:35.598902 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.702742 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.707980 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.710573 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8aa37359-983a-49e7-a135-80cec8936823 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:35.733834 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f5e086cd-7c5f-4399-8bcf-27eb80067541,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:35.738509 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:35.743485 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.745165 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-d9930b64-1c11-4894-a8f4-a2f82bbd28ff tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3079164 May 26 14:51:35.747986 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48514) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:35.753314 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'security_group_rule': {'security_group_id': '10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3', 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:35.759348 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:35.763363 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:security_group_rule and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:35.766387 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:35.772240 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:35.784125 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.securitygroups_db [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Project 28b9778de23c484bb66e4ac1f5aeb2c5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 26 14:51:35.789952 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.856251 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.860708 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.862912 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4e797acb-4ae5-43ca-b453-39a10395d442 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:35.883170 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=521dba8b-4537-4b16-ae6f-d56bed34ae8e,revision_number=0']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:35.887296 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:35.897384 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:35.899115 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b2aa5242-ba26-45c3-93ca-3d1cebb3233d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1499643 May 26 14:51:35.901935 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48522) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:35.907806 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'security_group_rule': {'security_group_id': '10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3', 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:35.914199 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:35.918147 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:security_group_rule and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:35.921593 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:35.927626 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:35.939393 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.securitygroups_db [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Project 28b9778de23c484bb66e4ac1f5aeb2c5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 26 14:51:35.945424 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:36.018837 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:36.023104 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506501'] for security_group_rule, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:36.025151 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:36.049597 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5edf8d89-9aed-4999-aa6b-01dc6e93ca31,revision_number=0']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:36.052071 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:36.059522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:36.060749 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-39956d59-5bf0-4feb-ab92-075a38e558bd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1577771 May 26 14:51:36.419787 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:36.493121 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:36.498276 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:36.498711 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:36.633440 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:36.650770 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:36.656144 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:36.658880 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:36.733679 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:36.736797 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:37.233373 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:51:37.600583 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48596) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:37.670811 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Sync routers for ids ['08aad9f4-39ef-41df-a92c-f8a161593b8b'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:51:37.697883 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Routers {'08aad9f4-39ef-41df-a92c-f8a161593b8b'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:37.698604 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['08aad9f4-39ef-41df-a92c-f8a161593b8b'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:37.733447 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:37.748949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:37.753187 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Usage tracker for resource:security_group_rule and tenant:17cd012233fc40a3b8ae8e6cecc1915f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:37.756429 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:37.762685 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:37.851920 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:37.857051 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:37.865914 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9c400b3b-c012-4ac6-a50f-487e2290a2df admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:37.890584 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Set router 08aad9f4-39ef-41df-a92c-f8a161593b8b gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:37.907390 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=17cd012233fc40a3b8ae8e6cecc1915f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3054206 May 26 14:51:37.909002 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91f8ce62-4324-4f25-8996-bff61d28f698,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:37.910337 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48604) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:37.912229 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-782b8feb-631e-46e8-8696-975a962f0a73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:37.976613 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-abafc36b-15ce-488d-9972-010467e6c09a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.004119 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-abafc36b-15ce-488d-9972-010467e6c09a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.059353 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-abafc36b-15ce-488d-9972-010467e6c09a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.064535 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0d46615a-d731-49d1-baa8-9a5928dba6c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:38.077827 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abafc36b-15ce-488d-9972-010467e6c09a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91f8ce62-4324-4f25-8996-bff61d28f698,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:38.084520 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-abafc36b-15ce-488d-9972-010467e6c09a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:38.086226 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-abafc36b-15ce-488d-9972-010467e6c09a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.090482 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-abafc36b-15ce-488d-9972-010467e6c09a admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/91f8ce62-4324-4f25-8996-bff61d28f698 HTTP/1.1" status: 204 len: 168 time: 0.1758566 May 26 14:51:38.219845 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201'}], 'enable_snat': True}, 'gw_port_id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:51:33Z', 'revision_number': 4, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port': {'id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:10:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:29Z', 'updated_at': '2021-05-26T14:51:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f7927c93-7c71-4890-bf98-14084da6ec98', 'name': '', 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'mac_address': 'fa:16:3e:8b:fe:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'a62bd878-2032-417d-a192-a8107571412e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:32Z', 'updated_at': '2021-05-26T14:51:33Z', 'revision_number': 2, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'subnets': [{'id': 'a62bd878-2032-417d-a192-a8107571412e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:38.224763 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Checking router: 08aad9f4-39ef-41df-a92c-f8a161593b8b for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:51:38.225226 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Updating router 08aad9f4-39ef-41df-a92c-f8a161593b8b port f7927c93-7c71-4890-bf98-14084da6ec98 binding host dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 26 14:51:38.283165 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.407352 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48612) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:38.421845 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:38.431459 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.447437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:38.452592 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Usage tracker for resource:security_group_rule and tenant:f66d15cffbaa4a229da3fe1746c3813c is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:38.456931 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:38.463695 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:38.498269 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:38.498570 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.564535 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.570492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.585703 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f2e797c6-b947-491e-a12e-a1b3aa14e829 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:38.637683 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Notify callbacks [] for port, precommit_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.650186 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.provisioning_blocks [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Transition to ACTIVE for port object f7927c93-7c71-4890-bf98-14084da6ec98 will not be triggered until provisioned by entity L2. {{(pid=98447) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:38.658947 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.663477 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f66d15cffbaa4a229da3fe1746c3813c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2546272 May 26 14:51:38.663875 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-1f0cee12-f044-4d8c-b26a-70b321cb7312 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:38.664882 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ca805af-b5ac-4d4e-b717-989143bce409,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:38.666251 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48616) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:38.669621 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-b4425305-65aa-4aab-ab6a-e32b778091c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:38.738913 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-efdd9757-2355-4bb0-8036-cb18ef593a84 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.773954 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-efdd9757-2355-4bb0-8036-cb18ef593a84 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.796336 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7785cc-19d1-4bcd-a154-4ae3661d242d None None] Pushing event updated for resources: {'Port': ['ID=f7927c93-7c71-4890-bf98-14084da6ec98,revision_number=3']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:38.823041 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-4d7785cc-19d1-4bcd-a154-4ae3661d242d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:38.849051 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-efdd9757-2355-4bb0-8036-cb18ef593a84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.854574 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-f7a7b1be-70bc-4e34-8f0e-be680f035570 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:38.871807 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efdd9757-2355-4bb0-8036-cb18ef593a84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ca805af-b5ac-4d4e-b717-989143bce409,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:38.874621 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-efdd9757-2355-4bb0-8036-cb18ef593a84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:38.884799 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-efdd9757-2355-4bb0-8036-cb18ef593a84 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.886847 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-efdd9757-2355-4bb0-8036-cb18ef593a84 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/4ca805af-b5ac-4d4e-b717-989143bce409 HTTP/1.1" status: 204 len: 168 time: 0.2160852 May 26 14:51:38.903629 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Attempting to bind port f7927c93-7c71-4890-bf98-14084da6ec98 on host dv-cinder-774594-6-iscsi for vnic_type normal with profile {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:51:38.904726 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Attempting to bind port f7927c93-7c71-4890-bf98-14084da6ec98 by drivers openvswitch,hyperv on host dv-cinder-774594-6-iscsi at level 0 using segments [{'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:51:38.906775 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Attempting to bind port f7927c93-7c71-4890-bf98-14084da6ec98 on network 03f468fb-31b1-4cd2-9057-202c8933354e {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:51:38.913501 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Checking agent: {'id': 'f3678ce8-96eb-4697-b6a8-b574ad753011', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-774594-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 34, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 35, 24), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 51, 25), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-774594-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:51:38.914199 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Checking segment: {'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98447) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:38.915384 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:38.915942 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Bound using segment: {'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'} {{(pid=98447) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:51:38.916564 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.managers [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Bound port: f7927c93-7c71-4890-bf98-14084da6ec98, host: dv-cinder-774594-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8e926a3-ea56-493c-bb6a-a41b3652bb24', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1126, 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e'}}] {{(pid=98447) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:51:38.917094 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:39.050193 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] For port f7927c93-7c71-4890-bf98-14084da6ec98, host dv-cinder-774594-6-iscsi, cleared binding levels {{(pid=98447) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:51:39.053390 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.plugins.ml2.db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] For port f7927c93-7c71-4890-bf98-14084da6ec98, host dv-cinder-774594-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=f7927c93-7c71-4890-bf98-14084da6ec98,segment=NetworkSegment(b8e926a3-ea56-493c-bb6a-a41b3652bb24),segment_id=b8e926a3-ea56-493c-bb6a-a41b3652bb24)] {{(pid=98447) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:51:39.060925 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron_lib.callbacks.manager [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98447) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:39.065990 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-5ffe1e04-e75d-4554-8a14-131a085128cd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:39.135309 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Routers {'08aad9f4-39ef-41df-a92c-f8a161593b8b'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:51:39.135965 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['08aad9f4-39ef-41df-a92c-f8a161593b8b'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:39.283899 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7785cc-19d1-4bcd-a154-4ae3661d242d None None] Pushing event updated for resources: {'Port': ['ID=f7927c93-7c71-4890-bf98-14084da6ec98,revision_number=4']} {{(pid=98447) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:39.315817 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG oslo_concurrency.lockutils [None req-4d7785cc-19d1-4bcd-a154-4ae3661d242d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=98447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:39.346205 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] Set router 08aad9f4-39ef-41df-a92c-f8a161593b8b gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:51:39.672278 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201'}], 'enable_snat': True}, 'gw_port_id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:51:33Z', 'revision_number': 4, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port': {'id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:10:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:29Z', 'updated_at': '2021-05-26T14:51:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f7927c93-7c71-4890-bf98-14084da6ec98', 'name': '', 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'mac_address': 'fa:16:3e:8b:fe:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'a62bd878-2032-417d-a192-a8107571412e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:32Z', 'updated_at': '2021-05-26T14:51:39Z', 'revision_number': 4, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'subnets': [{'id': 'a62bd878-2032-417d-a192-a8107571412e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:51:39.676916 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74afdbb3-f2a9-40dc-ade9-181419173f10 None None] The sync data for ids ['08aad9f4-39ef-41df-a92c-f8a161593b8b'] in dv-cinder-774594-6-iscsi is: [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201'}], 'enable_snat': True}, 'gw_port_id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:51:33Z', 'revision_number': 4, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port': {'id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:10:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:29Z', 'updated_at': '2021-05-26T14:51:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f7927c93-7c71-4890-bf98-14084da6ec98', 'name': '', 'network_id': '03f468fb-31b1-4cd2-9057-202c8933354e', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'mac_address': 'fa:16:3e:8b:fe:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_interface', 'standard_attr_id': 634, 'fixed_ips': [{'subnet_id': 'a62bd878-2032-417d-a192-a8107571412e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:32Z', 'updated_at': '2021-05-26T14:51:39Z', 'revision_number': 4, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'subnets': [{'id': 'a62bd878-2032-417d-a192-a8107571412e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:51:40.429701 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device f7927c93-7c71-4890-bf98-14084da6ec98 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:40.501168 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning for port f7927c93-7c71-4890-bf98-14084da6ec98 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:40.510830 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port f7927c93-7c71-4890-bf98-14084da6ec98 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:40.511216 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:40.634907 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:40.675573 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] For port f7927c93-7c71-4890-bf98-14084da6ec98, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=f7927c93-7c71-4890-bf98-14084da6ec98,segment=NetworkSegment(b8e926a3-ea56-493c-bb6a-a41b3652bb24),segment_id=b8e926a3-ea56-493c-bb6a-a41b3652bb24)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:51:40.681051 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:40.683131 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:40.774678 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Pushing event updated for resources: {'Port': ['ID=f7927c93-7c71-4890-bf98-14084da6ec98,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:40.777915 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:42.419038 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device f7927c93-7c71-4890-bf98-14084da6ec98 up at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:51:42.493128 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Provisioning complete for port f7927c93-7c71-4890-bf98-14084da6ec98 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:42.493505 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:48.694436 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48762) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:48.818141 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:48.833215 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:48.837174 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Usage tracker for resource:security_group_rule and tenant:d5739e77f259498fb798bf1d15d44bdc is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:48.840034 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:48.845861 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:48.933031 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:48.939190 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:48.948885 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-38dff369-10b8-48e8-97d8-6aeb986d600c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:48.995112 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=d5739e77f259498fb798bf1d15d44bdc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2994416 May 26 14:51:48.996157 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48d00e53-6e25-4a78-91fe-8c84794f1852,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:48.998041 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48774) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:49.000089 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:49.056573 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7160ba54-7d16-4089-987c-154a94e61ae5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.082177 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7160ba54-7d16-4089-987c-154a94e61ae5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.138426 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7160ba54-7d16-4089-987c-154a94e61ae5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.143439 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-accd4eb5-9d35-4a6e-912a-fcde36113c22 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:49.155770 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7160ba54-7d16-4089-987c-154a94e61ae5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48d00e53-6e25-4a78-91fe-8c84794f1852,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:49.162153 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7160ba54-7d16-4089-987c-154a94e61ae5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:49.162153 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-7160ba54-7d16-4089-987c-154a94e61ae5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.170074 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-7160ba54-7d16-4089-987c-154a94e61ae5 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/48d00e53-6e25-4a78-91fe-8c84794f1852 HTTP/1.1" status: 204 len: 168 time: 0.1657209 May 26 14:51:49.464753 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48786) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:49.483474 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.498342 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:49.502882 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Usage tracker for resource:security_group_rule and tenant:3f21c1dc27d0416fa4bc6996c64d687a is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:49.505927 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:49.512435 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:49.596611 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.603508 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.611505 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-91e09457-e507-4a89-8e82-8c31a7e63717 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:49.649786 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=3f21c1dc27d0416fa4bc6996c64d687a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1838958 May 26 14:51:49.651464 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ed76346-f790-42ff-92d8-323170f04a58,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:49.652693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48790) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:49.654456 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-c168ff39-868b-4d83-9c0d-196c701339d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:49.716066 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c37c415f-8774-4d09-b0ef-eb8dc92b8024 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.751558 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c37c415f-8774-4d09-b0ef-eb8dc92b8024 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.805650 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c37c415f-8774-4d09-b0ef-eb8dc92b8024 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.809315 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c05619a2-bf2c-4689-a703-b9a812801489 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:49.823351 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c37c415f-8774-4d09-b0ef-eb8dc92b8024 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ed76346-f790-42ff-92d8-323170f04a58,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:49.826632 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-c37c415f-8774-4d09-b0ef-eb8dc92b8024 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:49.836620 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-c37c415f-8774-4d09-b0ef-eb8dc92b8024 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:49.837771 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-c37c415f-8774-4d09-b0ef-eb8dc92b8024 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/6ed76346-f790-42ff-92d8-323170f04a58 HTTP/1.1" status: 204 len: 168 time: 0.1841245 May 26 14:51:50.191627 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48800) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:50.210107 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:50.225150 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:50.229360 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Usage tracker for resource:security_group_rule and tenant:f64922260286419888ffa95ede34ed1b is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:50.232457 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:50.238969 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:50.321384 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:50.327596 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:50.334509 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f2924d3b-ea04-4940-b88b-120ce01ca4be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:50.374553 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=f64922260286419888ffa95ede34ed1b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1818655 May 26 14:51:50.376279 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b790f556-de31-4cd1-abe1-723713699a78,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:50.377412 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48804) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:50.379372 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-ca7f50dc-9fbc-4893-b8bb-e620519e00cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:50.437345 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-127968fc-71ef-435b-891f-c758faae2b55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:50.464626 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-127968fc-71ef-435b-891f-c758faae2b55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:50.520365 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-127968fc-71ef-435b-891f-c758faae2b55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:50.524283 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-04f6109d-5ec7-4bbc-bf39-f4cd125bb828 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:50.537378 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-127968fc-71ef-435b-891f-c758faae2b55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b790f556-de31-4cd1-abe1-723713699a78,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:50.539987 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-127968fc-71ef-435b-891f-c758faae2b55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:50.548353 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-127968fc-71ef-435b-891f-c758faae2b55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:50.549454 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-127968fc-71ef-435b-891f-c758faae2b55 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b790f556-de31-4cd1-abe1-723713699a78 HTTP/1.1" status: 204 len: 168 time: 0.1703131 May 26 14:51:51.637940 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-988d9065-8d87-402e-8bd4-b8d067658f4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:53.282574 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c80b674a-2f2e-4815-8725-50c5bce8f9d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:53.381979 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-693e8968-6025-41fa-978d-003d3f436a89 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Synchronizing usage tracker for tenant:28b9778de23c484bb66e4ac1f5aeb2c5 on resource:security_group {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:51:53.402522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-693e8968-6025-41fa-978d-003d3f436a89 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Unset dirty status for tenant:28b9778de23c484bb66e4ac1f5aeb2c5 on resource:security_group {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:51:53.403868 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-693e8968-6025-41fa-978d-003d3f436a89 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-971879507&fields=id&tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5 HTTP/1.1" status: 200 len: 267 time: 0.0702851 May 26 14:51:53.563951 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-ffe0623e-3c64-4902-9cf1-7da8dfc0c50e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:53.565381 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-ffe0623e-3c64-4902-9cf1-7da8dfc0c50e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 809 time: 0.1534553 May 26 14:51:53.583755 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-c147f548-7a9a-4e0a-9d42-d643eaf6b9ad tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/quotas/28b9778de23c484bb66e4ac1f5aeb2c5 HTTP/1.1" status: 200 len: 375 time: 0.0099413 May 26 14:51:53.683689 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-c73c0f64-3339-473b-b8f2-3bd9b2460397 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0925169 May 26 14:51:53.820532 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-19d91a35-e642-4629-a29e-d762e4b9172a service neutron] 10.222.0.72 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1251769 May 26 14:51:53.953026 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-e4201483-162b-4faf-b42c-8c5392191b70 service neutron] 10.222.0.72 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1263554 May 26 14:51:54.374895 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-283e1e6f-a1ad-46b6-ac93-da4d83b2b659 req-e2930a5b-57d2-4efe-8ed2-96943049df61 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 210 time: 0.0503953 May 26 14:51:54.575522 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:54.642729 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 48878) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:54.767965 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:54.784545 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:54.788449 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Usage tracker for resource:security_group_rule and tenant:024cc44abfbc406eae2d4c7b7f71f44f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:54.791303 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:54.796919 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:54.879614 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:54.884170 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:54.891235 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-0fdaa051-26b5-46fe-9e1a-a56d7140b0e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:54.931566 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=024cc44abfbc406eae2d4c7b7f71f44f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2876687 May 26 14:51:54.932626 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b542d78f-4984-47b5-9a30-14e8af25113e,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:54.934530 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 48884) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:51:54.935814 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-661c3b57-f1b2-47e1-881e-ef3e0d9c6561 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:55.004456 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2897064-687a-4c3c-9648-145b9ee2f9e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:55.031021 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2897064-687a-4c3c-9648-145b9ee2f9e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:55.085693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2897064-687a-4c3c-9648-145b9ee2f9e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:55.089668 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-fe6972f6-2509-44db-b4fe-ddd875b27199 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:55.102159 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2897064-687a-4c3c-9648-145b9ee2f9e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b542d78f-4984-47b5-9a30-14e8af25113e,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:55.108415 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d2897064-687a-4c3c-9648-145b9ee2f9e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:55.113048 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2897064-687a-4c3c-9648-145b9ee2f9e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:55.114286 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-d2897064-687a-4c3c-9648-145b9ee2f9e6 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b542d78f-4984-47b5-9a30-14e8af25113e HTTP/1.1" status: 204 len: 168 time: 0.1779404 May 26 14:51:55.541038 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1b285c30-f999-4cf2-a759-d5f33a0b2daa req-503487b7-b420-4739-9497-09ea6f62fc17 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 210 time: 0.0502939 May 26 14:51:55.578528 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-7f95171f-6ad3-442c-8eac-d8ffeabfbb00 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:55.579306 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-7f95171f-6ad3-442c-8eac-d8ffeabfbb00 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Synchronizing usage tracker for tenant:28b9778de23c484bb66e4ac1f5aeb2c5 on resource:network {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:51:55.598023 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-7f95171f-6ad3-442c-8eac-d8ffeabfbb00 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Unset dirty status for tenant:28b9778de23c484bb66e4ac1f5aeb2c5 on resource:network {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:51:55.599847 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-7f95171f-6ad3-442c-8eac-d8ffeabfbb00 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.79 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 809 time: 0.2052298 May 26 14:51:55.655913 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-1148ab24-6e8c-4a0f-8cdc-3ea0aa0548ce tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Synchronizing usage tracker for tenant:28b9778de23c484bb66e4ac1f5aeb2c5 on resource:security_group {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:51:55.668110 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-1148ab24-6e8c-4a0f-8cdc-3ea0aa0548ce tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Unset dirty status for tenant:28b9778de23c484bb66e4ac1f5aeb2c5 on resource:security_group {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:51:55.669473 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-1148ab24-6e8c-4a0f-8cdc-3ea0aa0548ce tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5 HTTP/1.1" status: 200 len: 379 time: 0.0543537 May 26 14:51:55.705605 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'port': {'device_id': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'admin_state_up': True, 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'security_groups': ['10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3']}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:55.861781 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:51:55.866781 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:port and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:51:55.869663 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:51:55.875952 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:51:55.882578 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:55.886514 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Made reservation on behalf of 28b9778de23c484bb66e4ac1f5aeb2c5 for: {'port': 1} {{(pid=98444) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:51:55.893552 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:55.917857 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:56.060980 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Allocated IP 172.20.0.13 (4950f4fb-5f1e-4749-92f0-4580bd8b7f80/acf544a2-b701-4da7-82b8-dbc54487e21b/75cc186e-5074-4469-92d5-751dfabe82ec) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:51:56.257567 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:56.273700 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Transition to ACTIVE for port object 75cc186e-5074-4469-92d5-751dfabe82ec will not be triggered until provisioned by entity DHCP. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:56.299096 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:56.305387 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a260fa9c-f88f-4277-96e1-f35d3f2ba684 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:56.387352 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:51:56.391623 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:51:56.394018 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:51:56.444841 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:56.469023 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:56.485632 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:56.486339 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:56.511592 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8104804 May 26 14:51:56.534227 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Request body: {'port': {'device_id': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:51:56.645672 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-d70b2169-8c99-46eb-9c9d-f9d5a931635f None None] Provisioning for port 75cc186e-5074-4469-92d5-751dfabe82ec completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:51:56.651178 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-d70b2169-8c99-46eb-9c9d-f9d5a931635f None None] Provisioning complete for port 75cc186e-5074-4469-92d5-751dfabe82ec triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:51:56.651558 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d70b2169-8c99-46eb-9c9d-f9d5a931635f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:56.671712 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:56.710285 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-d70b2169-8c99-46eb-9c9d-f9d5a931635f None None] Port 75cc186e-5074-4469-92d5-751dfabe82ec cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:51:56.773791 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed947b13-5c80-4eb1-ac86-d5bc113b9049 req-b27283f7-6cc2-4d76-b7b0-201e39178dfa tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:56.775998 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ed947b13-5c80-4eb1-ac86-d5bc113b9049 req-b27283f7-6cc2-4d76-b7b0-201e39178dfa tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 932 time: 0.0902629 May 26 14:51:56.823818 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ed947b13-5c80-4eb1-ac86-d5bc113b9049 req-e45b556c-d023-4006-97d2-254cd589084f tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414760 May 26 14:51:57.131574 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 75cc186e-5074-4469-92d5-751dfabe82ec {{(pid=98444) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:51:57.139355 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:57.154090 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.provisioning_blocks [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Transition to ACTIVE for port object 75cc186e-5074-4469-92d5-751dfabe82ec will not be triggered until provisioned by entity L2. {{(pid=98444) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:51:57.161475 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:57.166611 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-3c6a6383-6c06-457f-9287-f2c00d7953d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:57.295935 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Pushing event updated for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:57.322927 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:57.404940 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Attempting to bind port 75cc186e-5074-4469-92d5-751dfabe82ec on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:51:57.405141 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Attempting to bind port 75cc186e-5074-4469-92d5-751dfabe82ec by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:51:57.405499 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Attempting to bind port 75cc186e-5074-4469-92d5-751dfabe82ec on network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:51:57.410764 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Port 75cc186e-5074-4469-92d5-751dfabe82ec on network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:51:57.411105 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Attempting to bind port 75cc186e-5074-4469-92d5-751dfabe82ec on network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:51:57.416267 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 51, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:51:57.416598 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Checking segment: {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98444) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:51:57.416975 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Bound using segment: {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'} {{(pid=98444) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:51:57.417395 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.managers [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Bound port: 75cc186e-5074-4469-92d5-751dfabe82ec, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c4a96841-5ad1-4e7d-bd36-df760e1caf70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1145, 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80'}}] {{(pid=98444) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:51:57.417727 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:57.508644 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, cleared binding levels {{(pid=98444) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:51:57.512060 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98444) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:51:57.518077 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:57.522293 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:51:57.544017 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:57.577692 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:57.578509 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:51:57.579965 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] 10.222.0.79 "PUT /v2.0/ports/75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 1094 time: 1.0553756 May 26 14:51:57.583804 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:51:57.612693 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Pushing event updated for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=3']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:51:57.628340 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-67f630e6-545d-4f73-98b5-86837e108779 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:51:57.673633 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec', 'status': 'completed', 'code': 200} May 26 14:51:57.717558 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-2bc50511-842c-49b8-ac5a-cbb00344bd35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:57.719114 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-2bc50511-842c-49b8-ac5a-cbb00344bd35 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1097 time: 0.0830369 May 26 14:51:57.798144 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-64a11964-6f44-4a03-88e8-98927390a9c9 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 217 time: 0.0666001 May 26 14:51:57.865595 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-8fb281df-b709-4eb4-8665-b7e3b30af041 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:57.867201 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-8fb281df-b709-4eb4-8665-b7e3b30af041 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 200 len: 848 time: 0.0635529 May 26 14:51:57.944547 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-d947d2ce-cc64-4bd3-a508-db789dd7ea65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:57.946205 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-d947d2ce-cc64-4bd3-a508-db789dd7ea65 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0720890 May 26 14:51:58.019938 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9925a080-3037-4719-9fd1-e9b341047154 req-b8cf12bd-09b0-4b89-b44d-e4beb1a66f3d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:58.021731 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9925a080-3037-4719-9fd1-e9b341047154 req-b8cf12bd-09b0-4b89-b44d-e4beb1a66f3d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0861816 May 26 14:51:58.093466 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-81485abd-bb43-4ee1-b0cc-9a992ad46779 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1411824 May 26 14:51:58.099869 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9925a080-3037-4719-9fd1-e9b341047154 req-ce2ab78d-ae93-4db8-b3b8-9f6accc58178 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0622327 May 26 14:51:58.236565 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-3808228d-4da8-4346-9e2a-9e83aec3f371 req-f016845a-d6ed-4137-8634-b80f42712768 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1365271 May 26 14:51:58.418162 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-e5ce9f3e-b8ba-4e75-af4e-ea5cf86331e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:58.419689 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-e5ce9f3e-b8ba-4e75-af4e-ea5cf86331e5 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1097 time: 0.0788891 May 26 14:51:58.539994 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-93910c19-32f5-4df0-86d9-88da1ae24e82 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0727508 May 26 14:51:58.556515 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-92c89ebb-2d23-43dc-b4fa-e154d4a40768 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:58.557967 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-92c89ebb-2d23-43dc-b4fa-e154d4a40768 service neutron] 10.222.0.79 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 911 time: 0.1317024 May 26 14:51:58.625287 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-0a5387b6-259f-4153-80a1-f8dba95c2f99 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 217 time: 0.0607023 May 26 14:51:58.644060 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-f36898b9-8a19-4b13-804a-8b2aa8282a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:58.645683 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-f36898b9-8a19-4b13-804a-8b2aa8282a4e service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 1099 time: 0.0733776 May 26 14:51:58.806723 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-5e31d7ee-6429-4b56-9798-c1e980e1805c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:58.808077 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-5e31d7ee-6429-4b56-9798-c1e980e1805c service neutron] 10.222.0.79 "GET /v2.0/subnets?id=acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 200 len: 848 time: 0.1772203 May 26 14:51:58.883701 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-2cec59ca-de94-4a61-b091-896708d0a55e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:58.885189 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-2cec59ca-de94-4a61-b091-896708d0a55e service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0709937 May 26 14:51:58.895443 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-7bcdc89e-4f6e-450d-9580-e7e11d0ba144 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:58.896880 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-7bcdc89e-4f6e-450d-9580-e7e11d0ba144 service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.2296197 May 26 14:51:58.998771 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-2a9f10a6-c18e-49ed-821a-0d00af7e7a1a service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 HTTP/1.1" status: 200 len: 1002 time: 0.0947752 May 26 14:51:59.015686 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-a3dcf80e-8a0e-422b-99f4-a8384567facf service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1234210 May 26 14:51:59.064673 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-e188bfc1-8b8e-4cdd-bea1-40976c1d8b09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:59.066057 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-e188bfc1-8b8e-4cdd-bea1-40976c1d8b09 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0617523 May 26 14:51:59.146949 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-32339a19-cfe7-435b-8d94-02c8e5fd738a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:59.148803 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-32339a19-cfe7-435b-8d94-02c8e5fd738a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0744872 May 26 14:51:59.150265 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-5b7aa424-fa95-44cb-b0d8-73a1e7f85b40 req-11ab5beb-ee5d-493a-82f0-c70907829ee5 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288860 May 26 14:51:59.359069 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-8900d1d2-3896-49ec-8707-8202c6a1f84a service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1889715 May 26 14:51:59.396556 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0b876c-5b96-4411-a8a1-a783de74b93d req-2435cc12-039b-4144-bcca-3ec275672775 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:51:59.398082 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ae0b876c-5b96-4411-a8a1-a783de74b93d req-2435cc12-039b-4144-bcca-3ec275672775 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.1545596 May 26 14:51:59.516596 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ae0b876c-5b96-4411-a8a1-a783de74b93d req-bc7e2c59-9484-4ded-8679-0753e9b2af1d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0716097 May 26 14:51:59.539502 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7f095126-7060-48ef-ae30-d42cbd174b65 req-deb821ca-c163-4eb1-95f7-c74b4832dd1a service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1689489 May 26 14:52:00.723463 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d00236-4fee-43ec-8918-7f341373e3fe req-dcfbc591-bc3a-4e2b-9d3a-6d5c35a69030 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:00.724929 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f4d00236-4fee-43ec-8918-7f341373e3fe req-dcfbc591-bc3a-4e2b-9d3a-6d5c35a69030 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0925672 May 26 14:52:00.778388 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f4d00236-4fee-43ec-8918-7f341373e3fe req-7889b702-85fa-4db1-a14e-298b9cd0e7bf tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442305 May 26 14:52:01.963033 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08240643-3226-4f17-a7a9-eb1db91a96ce req-b3091eda-b482-4fb6-b696-c04c21c10228 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:01.964458 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-08240643-3226-4f17-a7a9-eb1db91a96ce req-b3091eda-b482-4fb6-b696-c04c21c10228 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0813832 May 26 14:52:02.009700 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-08240643-3226-4f17-a7a9-eb1db91a96ce req-abe00339-3fa4-401c-a32d-77a621598bf1 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393667 May 26 14:52:03.200630 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f51443e-fdd7-4df0-b14f-e708fe9c29b4 req-5ee2518f-7130-4f61-946e-670004755777 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:03.202102 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f51443e-fdd7-4df0-b14f-e708fe9c29b4 req-5ee2518f-7130-4f61-946e-670004755777 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0840456 May 26 14:52:03.246798 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2f51443e-fdd7-4df0-b14f-e708fe9c29b4 req-2b6a1747-b4b6-440c-8f32-e1a207eb3216 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386217 May 26 14:52:04.447134 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32696b55-ceae-44e6-9f60-5e84d8c3e72d req-f37700f6-2ebc-46e3-acab-7e7b270628a6 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:04.448522 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-32696b55-ceae-44e6-9f60-5e84d8c3e72d req-f37700f6-2ebc-46e3-acab-7e7b270628a6 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0907257 May 26 14:52:04.497202 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-32696b55-ceae-44e6-9f60-5e84d8c3e72d req-00f3556c-8f85-4011-9f43-3de2db3bbf88 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402973 May 26 14:52:05.706742 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6374de15-6cca-4a18-a269-a311d8465079 req-a2a767f5-b5d4-450f-a69c-73367fd15bd1 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:05.708156 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6374de15-6cca-4a18-a269-a311d8465079 req-a2a767f5-b5d4-450f-a69c-73367fd15bd1 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0884650 May 26 14:52:05.751709 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6374de15-6cca-4a18-a269-a311d8465079 req-df465ccb-6caa-495e-ac93-2d75ec6bdef0 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377018 May 26 14:52:05.988326 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 75cc186e-5074-4469-92d5-751dfabe82ec details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:52:06.122381 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:52:06.136031 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '75cc186e-5074-4469-92d5-751dfabe82ec', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'port_id': '75cc186e-5074-4469-92d5-751dfabe82ec', 'mac_address': 'fa:16:3e:55:ce:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:52:06.193601 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:06.211777 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75cc186e-5074-4469-92d5-751dfabe82ec {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:52:06.227611 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:52:06.232467 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:06.234326 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-60f58817-6cd1-429f-bdb9-473c27235da9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:06.304191 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:06.307416 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:06.525333 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['75cc186e-5074-4469-92d5-751dfabe82ec'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:52:06.940906 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21a22e49-db62-4e22-b083-9c88b4dc969b req-d27772e4-eea5-4c13-9d61-184cfd9ac46e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:06.942349 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21a22e49-db62-4e22-b083-9c88b4dc969b req-d27772e4-eea5-4c13-9d61-184cfd9ac46e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 945 time: 0.0817676 May 26 14:52:06.991425 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21a22e49-db62-4e22-b083-9c88b4dc969b req-dae5b3e1-76e8-4b4b-9e8f-64e3443c3e94 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432434 May 26 14:52:07.341916 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49044) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:52:07.465927 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:07.484860 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:52:07.488908 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Usage tracker for resource:security_group_rule and tenant:5b6cda18e89a49db9cf5350df193de7b is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:52:07.491795 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:52:07.497584 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:52:07.581004 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:07.586453 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:07.593418 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e48c5325-283d-4735-b0fd-6fa770466ebf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:07.631873 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35e580e9-3223-413f-b48b-9d91ec6550a1,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:07.644676 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=5b6cda18e89a49db9cf5350df193de7b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3016396 May 26 14:52:07.645643 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f9687fa1-de47-40b7-a5f3-6e11b92aa187 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:07.648287 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49050) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:52:07.707576 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:07.732617 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:07.783873 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:07.787429 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1d72149a-8acf-4351-be8c-d2e9758aaed8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:07.800119 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35e580e9-3223-413f-b48b-9d91ec6550a1,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:07.811401 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.811777 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.812144 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.812487 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.812836 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.813188 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.813535 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.813882 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.814256 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.814623 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.814966 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.815304 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:07.818578 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:07.819814 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:07.823527 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-24cad75c-f478-41f7-a338-1cd93b117ec3 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/35e580e9-3223-413f-b48b-9d91ec6550a1 HTTP/1.1" status: 204 len: 168 time: 0.1717739 May 26 14:52:08.003308 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 75cc186e-5074-4469-92d5-751dfabe82ec up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:52:08.078182 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 75cc186e-5074-4469-92d5-751dfabe82ec completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:52:08.085562 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 75cc186e-5074-4469-92d5-751dfabe82ec triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:52:08.086445 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:08.207597 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3762e350-73c9-4756-bd6a-c7f6a6fedca5 req-f52d76d9-345f-4c9c-97d6-7ad37fa35d74 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:08.209082 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3762e350-73c9-4756-bd6a-c7f6a6fedca5 req-f52d76d9-345f-4c9c-97d6-7ad37fa35d74 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 945 time: 0.0945961 May 26 14:52:08.212364 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:08.239291 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:52:08.249063 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:52:08.254618 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3762e350-73c9-4756-bd6a-c7f6a6fedca5 req-3f249438-0625-4adb-84e4-278a5ad45281 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394521 May 26 14:52:08.254788 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:08.256904 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:08.293037 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec', 'code': 200} May 26 14:52:08.324820 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:08.327882 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:08.600596 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0a4415-6554-4be7-bfe0-3fae0ee8177b req-47a86490-2646-4036-a9d1-9ab5a82a1eb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:08.602098 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7b0a4415-6554-4be7-bfe0-3fae0ee8177b req-47a86490-2646-4036-a9d1-9ab5a82a1eb7 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1099 time: 0.0730081 May 26 14:52:08.643124 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7b0a4415-6554-4be7-bfe0-3fae0ee8177b req-f2747df0-631a-4d16-afea-62797c58855b service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0346296 May 26 14:52:09.546902 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a8f5eb2-f0b8-4395-aeee-62d9a4f1fc79 req-5aab580d-8214-4450-956a-5ac9cdc1d654 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:09.548331 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0a8f5eb2-f0b8-4395-aeee-62d9a4f1fc79 req-5aab580d-8214-4450-956a-5ac9cdc1d654 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.1776748 May 26 14:52:09.592808 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0a8f5eb2-f0b8-4395-aeee-62d9a4f1fc79 req-3307ad77-5f51-4545-afcb-25f0864498b2 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387137 May 26 14:52:10.798262 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c613182-c6bc-4ab4-9454-e53455afac4a req-bd3e32f8-da0a-4930-b064-7d1c14a1c977 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:10.799946 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9c613182-c6bc-4ab4-9454-e53455afac4a req-bd3e32f8-da0a-4930-b064-7d1c14a1c977 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0860739 May 26 14:52:10.846172 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9c613182-c6bc-4ab4-9454-e53455afac4a req-19a09ff5-77b8-4409-9a19-396c5edd8b55 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404665 May 26 14:52:11.053488 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8269873a-0697-4c4d-90f9-6669fcb12a33 req-d0a2d1b3-1889-4007-a16b-844923c800ea tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:11.055024 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8269873a-0697-4c4d-90f9-6669fcb12a33 req-d0a2d1b3-1889-4007-a16b-844923c800ea tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0947216 May 26 14:52:11.102580 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8269873a-0697-4c4d-90f9-6669fcb12a33 req-f4b2650e-e134-4760-86c8-4af3f6c7c669 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415130 May 26 14:52:11.131465 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49066) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:52:11.372086 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04ba02cf-a30c-4215-b67b-1afe61766aeb tempest-TestShelveInstance-525483869 tempest-TestShelveInstance-525483869-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:11.372795 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-04ba02cf-a30c-4215-b67b-1afe61766aeb tempest-TestShelveInstance-525483869 tempest-TestShelveInstance-525483869-project-admin] Synchronizing usage tracker for tenant:78915a8765bc4d5cb1781cbe6eebe45d on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:52:11.392240 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-04ba02cf-a30c-4215-b67b-1afe61766aeb tempest-TestShelveInstance-525483869 tempest-TestShelveInstance-525483869-project-admin] Unset dirty status for tenant:78915a8765bc4d5cb1781cbe6eebe45d on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:52:11.393489 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-04ba02cf-a30c-4215-b67b-1afe61766aeb tempest-TestShelveInstance-525483869 tempest-TestShelveInstance-525483869-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1094 time: 0.2610798 May 26 14:52:11.396861 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49072) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:52:11.402452 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'port_id': '75cc186e-5074-4469-92d5-751dfabe82ec', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'fixed_ip_address': '172.20.0.13'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:52:11.408869 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:52:11.413094 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Usage tracker for resource:floatingip and tenant:28b9778de23c484bb66e4ac1f5aeb2c5 is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:52:11.416188 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:52:11.423053 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:52:11.434916 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for floatingip, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:11.580048 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:11.733504 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Allocated IP 172.27.3.163 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/48c8ea20-ebe6-430c-947f-51af8474ddbb) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:52:11.883807 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:11.915653 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:11.919382 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-630c2d9b-e6f1-49dc-a739-b1393b2f0a27 tempest-AttachVolumeShelveTestJSON-2029551391 tempest-AttachVolumeShelveTestJSON-2029551391-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:11.982722 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:52:11.985788 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:52:11.988400 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:52:12.025482 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'Port': ['ID=48c8ea20-ebe6-430c-947f-51af8474ddbb,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:12.041762 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.042128 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.042512 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.042866 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.043212 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.043556 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.043898 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.044238 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.044578 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.044917 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.045257 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.045589 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:12.050441 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:12.421345 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:12.497834 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:12.802956 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:12.810160 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:12.813639 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-12542401-a051-4d18-96ce-013ff9e378d1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:12.912577 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event updated for resources: {'Port': ['ID=48c8ea20-ebe6-430c-947f-51af8474ddbb,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:12.916594 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:12.925251 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:13.101401 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Floating IP 663ac210-fd9a-476f-a587-2f1a057e92bd associated. External IP: 172.27.3.163, port: 75cc186e-5074-4469-92d5-751dfabe82ec. May 26 14:52:13.465217 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Router 4a536108-40a6-42ed-a3fe-5ad5763534db has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:52:13.647956 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:52:13.658103 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] Sync routers for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:52:13.668012 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:52:13.668651 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:13.680412 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:13.735298 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-052da0e2-4fa5-426f-89d2-0537cef2cb25 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.3372812 May 26 14:52:13.735976 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:52:13.787018 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec', 'status': 'completed', 'code': 200} May 26 14:52:13.851105 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:52:13.899867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-d2945953-9480-40b4-90e4-cf361234a60b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:13.901351 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-d2945953-9480-40b4-90e4-cf361234a60b service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1099 time: 0.0710194 May 26 14:52:14.031347 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-4b772935-1f29-471f-ae40-5aa732b8e86f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:14.032754 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-4b772935-1f29-471f-ae40-5aa732b8e86f service neutron] 10.222.0.79 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 911 time: 0.1252069 May 26 14:52:14.139710 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-a926de12-e989-426e-94fe-0a4cbac2a75b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 1000 time: 0.0995567 May 26 14:52:14.197462 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '663ac210-fd9a-476f-a587-2f1a057e92bd', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'floating_ip_address': '172.27.3.163', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'port_id': '75cc186e-5074-4469-92d5-751dfabe82ec', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'mac_address': 'fa:16:3e:55:ce:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:12Z', 'updated_at': '2021-05-26T14:52:12Z', 'revision_number': 0, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:30Z', 'revision_number': 5, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:14.201867 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] Checking router: 4a536108-40a6-42ed-a3fe-5ad5763534db for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:52:14.206818 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-d3fe1a4c-d32d-4156-bcbf-4d3b57b8cc96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:14.208274 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-d3fe1a4c-d32d-4156-bcbf-4d3b57b8cc96 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 200 len: 848 time: 0.0628548 May 26 14:52:14.210585 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:52:14.211180 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:51:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:14.232198 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:52:14.288167 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-72a6efe0-94d1-479d-8038-7756d8667e72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:14.289532 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-72a6efe0-94d1-479d-8038-7756d8667e72 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0744126 May 26 14:52:14.423341 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:52:14.425615 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-1492c126-83c3-41bd-9623-34153419d416 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291616 May 26 14:52:14.557470 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-30fdcdad-1b5e-4911-937d-515465140dc2 req-89015bd2-5231-46f2-af3e-0a2e23089170 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259136 May 26 14:52:14.780372 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '663ac210-fd9a-476f-a587-2f1a057e92bd', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'floating_ip_address': '172.27.3.163', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'port_id': '75cc186e-5074-4469-92d5-751dfabe82ec', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'mac_address': 'fa:16:3e:55:ce:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:12Z', 'updated_at': '2021-05-26T14:52:12Z', 'revision_number': 0, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:30Z', 'revision_number': 5, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:14.784812 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82470133-6962-4fa8-8275-5b71c58f00e3 None None] The sync data for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi is: [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '663ac210-fd9a-476f-a587-2f1a057e92bd', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'floating_ip_address': '172.27.3.163', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'port_id': '75cc186e-5074-4469-92d5-751dfabe82ec', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'mac_address': 'fa:16:3e:55:ce:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:12Z', 'updated_at': '2021-05-26T14:52:12Z', 'revision_number': 0, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:30Z', 'revision_number': 5, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:52:14.990743 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c24e089e-13d7-43aa-bde8-6aa168565203 None None] New status for floating IP 663ac210-fd9a-476f-a587-2f1a057e92bd: ACTIVE {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:52:21.651820 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-0b5078b6-3221-4fe5-a71f-1c325fb20bcd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:23.286939 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7aad275b-98ca-44f6-9502-80f106c4e390 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:24.570703 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:25.897868 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:25.923601 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:27.514329 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:33.569494 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5997fe8c-7c48-4faa-8531-fc1340fb5d72 req-af1daf9c-ab76-4ce0-b5d6-8103822ff2e5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:33.570980 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5997fe8c-7c48-4faa-8531-fc1340fb5d72 req-af1daf9c-ab76-4ce0-b5d6-8103822ff2e5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 946 time: 0.0831518 May 26 14:52:33.619634 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5997fe8c-7c48-4faa-8531-fc1340fb5d72 req-394df968-596f-40a1-8f92-e0179572a598 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397561 May 26 14:52:34.830978 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84028317-04a8-4030-bfec-9d464ba75ea5 req-3436043b-e526-45c7-ada1-d326825eed28 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:34.832419 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-84028317-04a8-4030-bfec-9d464ba75ea5 req-3436043b-e526-45c7-ada1-d326825eed28 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 946 time: 0.0934021 May 26 14:52:34.877685 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-84028317-04a8-4030-bfec-9d464ba75ea5 req-2b622988-563b-41cb-a428-f61e1ff31014 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396512 May 26 14:52:35.259150 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-43095a10-64d7-4bbc-8dfa-cce3ece23a78 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:35.260582 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-43095a10-64d7-4bbc-8dfa-cce3ece23a78 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 946 time: 0.0892522 May 26 14:52:35.405729 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Deleting port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:52:35.406024 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:35.535689 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] For port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:52:35.540704 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:35.915149 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:35.915998 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:35.915998 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.l3_db [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Floating IP 379fb7bf-c0af-4316-b18b-c25404c58164 disassociated. External IP: 172.27.3.222, port: e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2. May 26 14:52:35.916192 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Calling delete_port for e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 owned by compute:nova {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:52:36.079282 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:36.084889 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-38e38c57-345a-4031-b4e7-24265aca1e82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:36.135372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event deleted for resources: {'Port': ['ID=e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:36.140895 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:36.208155 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f902187-2694-4583-9073-3471d576c105 req-af3111de-242c-4950-9cf5-b26021bef6cd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:36.209606 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9f902187-2694-4583-9073-3471d576c105 req-af3111de-242c-4950-9cf5-b26021bef6cd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 946 time: 0.2149625 May 26 14:52:36.337320 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9f902187-2694-4583-9073-3471d576c105 req-fe8ac54b-4d15-44ca-97a2-97281567e6e6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1197536 May 26 14:52:36.367936 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Router 39443462-555c-4ab6-8ab8-12514f6596b8 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:52:36.552038 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:52:36.561914 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:52:36.572951 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:52:36.574256 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:52:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:36.624837 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] No DVR routers for this DVR port e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 on host hv-cinder-77459 {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:52:36.627442 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:36.630235 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'name': 'network-vif-deleted', 'tag': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:52:36.638593 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-56aa508c-7f7f-4727-a200-378ec20a8a72 req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "DELETE /v2.0/ports/e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 HTTP/1.1" status: 204 len: 173 time: 1.3724046 May 26 14:52:36.678783 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b843f062-f651-4890-8c30-15b7b95b0dfc', 'name': 'network-vif-deleted', 'tag': 'e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2', 'status': 'completed', 'code': 200} May 26 14:52:36.754964 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:52:37.065443 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:37.069782 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:52:37.079366 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:52:37.079998 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:52:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:37.316561 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:52:37.507275 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-b6287b9f-aff8-40dd-b402-4cf63c548257 req-514054fe-93ec-4d0b-871f-606a317c1f79 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Synchronizing usage tracker for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:52:37.528261 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-b6287b9f-aff8-40dd-b402-4cf63c548257 req-514054fe-93ec-4d0b-871f-606a317c1f79 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Unset dirty status for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:52:37.529584 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b6287b9f-aff8-40dd-b402-4cf63c548257 req-514054fe-93ec-4d0b-871f-606a317c1f79 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=b843f062-f651-4890-8c30-15b7b95b0dfc HTTP/1.1" status: 200 len: 210 time: 0.0699136 May 26 14:52:37.634684 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:37.639466 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e10885a4-a8b9-413d-b1a9-4461d33e4e17 None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:52:37.840619 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47c98aa2-e768-4651-a81b-a92fc9eb6b9d None None] New status for floating IP 379fb7bf-c0af-4316-b18b-c25404c58164: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:52:38.130315 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:52:38.165149 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:52:38.165521 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device e1c23f60-1989-4d0b-a1d7-e41ff1cde4a2 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:52:38.899662 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-3ce9d421-69d3-4e75-bc7b-e12f9c46d27e tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1100445324&fields=id&tenant_id=054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 267 time: 0.0436580 May 26 14:52:39.048329 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-7464146a-4868-40b8-88d2-b5d5d7c4c879 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:39.049747 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-7464146a-4868-40b8-88d2-b5d5d7c4c879 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 811 time: 0.1434836 May 26 14:52:39.066842 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-8901bcdc-0d06-4fd0-9637-1b1476153db4 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/quotas/054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 375 time: 0.0090425 May 26 14:52:39.154129 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-a44c61a3-7b7a-4124-9e85-18620fac0a3a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0822499 May 26 14:52:39.298141 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-6bfd84af-b6e0-4b80-9c9c-0a3bb892a147 service neutron] 10.222.0.72 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1320493 May 26 14:52:39.545701 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-7e1bec36-ae67-4847-9ffa-3203d78bf910 service neutron] 10.222.0.72 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2386253 May 26 14:52:39.958821 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d904ef24-398a-4555-88d7-0f7b347bb12e req-bb2b44c3-0a51-4369-9f91-9aec3b65a615 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 210 time: 0.0450430 May 26 14:52:41.127410 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2ad3e51f-0d3a-475c-a69f-3c0b4cd9d1b1 req-7f748559-98bd-4a74-a3a1-da7cd422478c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 210 time: 0.0580630 May 26 14:52:41.173671 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-69c61909-40c1-4154-8267-e062aeb50994 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:41.175201 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-69c61909-40c1-4154-8267-e062aeb50994 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 811 time: 0.1968603 May 26 14:52:41.230232 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-e5da089e-01ae-43b8-a9f3-c00fb699c360 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 380 time: 0.0397842 May 26 14:52:41.250540 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'port': {'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'admin_state_up': True, 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'security_groups': ['ccbc02f3-8afe-463e-99ee-7fa02c671594']}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:52:41.405478 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:52:41.415191 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:52:41.427620 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Made reservation on behalf of 054087186333487b82b9a7a12d02c80f for: {'port': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:52:41.431300 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:41.615939 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Allocated IP 172.20.0.10 (0a3b5429-9434-492a-ba57-3dfc671d164c/be983207-7be6-448d-b3eb-3c77c2c0eda1/57a32134-be1e-490a-ac2e-088e73027408) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:52:41.843173 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:41.860083 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Transition to ACTIVE for port object 57a32134-be1e-490a-ac2e-088e73027408 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:52:41.893971 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:41.901700 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-88df28af-5559-409c-8ac8-f2261dd01af4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:41.971022 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Network 0a3b5429-9434-492a-ba57-3dfc671d164c is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:52:41.972149 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:52:41.974664 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:52:42.024610 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=57a32134-be1e-490a-ac2e-088e73027408,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:42.028701 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:42.051452 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:42.052114 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:42.078586 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8345358 May 26 14:52:42.097967 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Request body: {'port': {'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:52:42.209058 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-9d6666f8-f5f3-4daa-b52f-61ce245ef5b9 None None] Provisioning for port 57a32134-be1e-490a-ac2e-088e73027408 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:52:42.214200 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-9d6666f8-f5f3-4daa-b52f-61ce245ef5b9 None None] Provisioning complete for port 57a32134-be1e-490a-ac2e-088e73027408 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:52:42.214703 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-9d6666f8-f5f3-4daa-b52f-61ce245ef5b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:42.226069 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:42.270246 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-9d6666f8-f5f3-4daa-b52f-61ce245ef5b9 None None] Port 57a32134-be1e-490a-ac2e-088e73027408 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:52:42.425782 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00a0086-c357-4225-94e8-bcde46900463 req-a72b9387-f8c9-4e0e-a44f-b895fa47e033 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:42.426515 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-e00a0086-c357-4225-94e8-bcde46900463 req-a72b9387-f8c9-4e0e-a44f-b895fa47e033 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Synchronizing usage tracker for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:52:42.511531 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-e00a0086-c357-4225-94e8-bcde46900463 req-a72b9387-f8c9-4e0e-a44f-b895fa47e033 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Unset dirty status for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:52:42.512757 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e00a0086-c357-4225-94e8-bcde46900463 req-a72b9387-f8c9-4e0e-a44f-b895fa47e033 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 932 time: 0.2775149 May 26 14:52:42.584912 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e00a0086-c357-4225-94e8-bcde46900463 req-02ca77b5-d551-4b39-86e0-3584fdf2cf75 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0645058 May 26 14:52:42.680929 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 57a32134-be1e-490a-ac2e-088e73027408 {{(pid=98445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:52:42.690446 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:42.705347 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Transition to ACTIVE for port object 57a32134-be1e-490a-ac2e-088e73027408 will not be triggered until provisioned by entity L2. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:52:42.710590 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:42.714148 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e6551aee-4395-434e-8c9d-fb8215a2560a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:42.981802 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Pushing event updated for resources: {'Port': ['ID=57a32134-be1e-490a-ac2e-088e73027408,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:42.989052 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.275s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:43.062363 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Attempting to bind port 57a32134-be1e-490a-ac2e-088e73027408 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:52:43.062572 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Attempting to bind port 57a32134-be1e-490a-ac2e-088e73027408 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:52:43.062925 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Attempting to bind port 57a32134-be1e-490a-ac2e-088e73027408 on network 0a3b5429-9434-492a-ba57-3dfc671d164c {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:52:43.067947 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Port 57a32134-be1e-490a-ac2e-088e73027408 on network 0a3b5429-9434-492a-ba57-3dfc671d164c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:52:43.068278 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Attempting to bind port 57a32134-be1e-490a-ac2e-088e73027408 on network 0a3b5429-9434-492a-ba57-3dfc671d164c {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:52:43.073328 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 52, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:52:43.074073 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Checking segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:52:43.074499 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Bound using segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:52:43.074930 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Bound port: 57a32134-be1e-490a-ac2e-088e73027408, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:52:43.075277 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:43.164919 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] For port 57a32134-be1e-490a-ac2e-088e73027408, host hv-cinder-77459, cleared binding levels {{(pid=98445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:52:43.167767 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] For port 57a32134-be1e-490a-ac2e-088e73027408, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=57a32134-be1e-490a-ac2e-088e73027408,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:52:43.174199 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:43.177848 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b87aa742-8f7e-49e4-84a4-092818d9ca38 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:43.237897 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:43.238530 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:43.239982 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] 10.222.0.79 "PUT /v2.0/ports/57a32134-be1e-490a-ac2e-088e73027408 HTTP/1.1" status: 200 len: 1094 time: 1.1466577 May 26 14:52:43.240376 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'tag': '57a32134-be1e-490a-ac2e-088e73027408'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:52:43.261078 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Pushing event updated for resources: {'Port': ['ID=57a32134-be1e-490a-ac2e-088e73027408,revision_number=3']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:43.264396 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:43.330000 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'tag': '57a32134-be1e-490a-ac2e-088e73027408', 'status': 'completed', 'code': 200} May 26 14:52:43.374213 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-0c4d4b10-ff5e-4528-ad3a-1476dd9193d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:43.375799 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-0c4d4b10-ff5e-4528-ad3a-1476dd9193d4 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 1097 time: 0.0786250 May 26 14:52:43.454644 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-a456dbc5-ccb6-4171-a973-0b59c864bbbf service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=57a32134-be1e-490a-ac2e-088e73027408 HTTP/1.1" status: 200 len: 217 time: 0.0644813 May 26 14:52:43.518926 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-e39a42fb-0ac9-463b-bb67-e6059a3ef405 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:43.520238 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-e39a42fb-0ac9-463b-bb67-e6059a3ef405 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0596311 May 26 14:52:43.603779 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-bbb7eba5-e943-4a33-9730-e76f1d39b5d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:43.605268 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-bbb7eba5-e943-4a33-9730-e76f1d39b5d3 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0785701 May 26 14:52:43.785170 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-f02a5668-c5fa-413e-b95c-e4420431569f service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1731911 May 26 14:52:43.876638 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea15f0c-81d9-4982-ac50-cbe4b8f4fc17 req-c70fbb13-9a0b-4c73-a9fa-57f2c03800af tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:43.878058 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-eea15f0c-81d9-4982-ac50-cbe4b8f4fc17 req-c70fbb13-9a0b-4c73-a9fa-57f2c03800af tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 944 time: 0.1868858 May 26 14:52:43.952759 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-eea15f0c-81d9-4982-ac50-cbe4b8f4fc17 req-5d9ad64e-450c-4710-a7af-211e8ee9f894 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0675671 May 26 14:52:43.957968 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fbf5282-391e-42ba-bbef-479dc5b0ff80 req-31c8d4c9-beed-47ff-b221-c5cae78a85ab service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1661463 May 26 14:52:44.149240 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-02a635b2-ca5b-4125-b9a0-822e3c4c0a09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:44.150673 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-02a635b2-ca5b-4125-b9a0-822e3c4c0a09 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 1097 time: 0.0805304 May 26 14:52:44.283667 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-62a2f49b-6c33-4513-b5c6-f18420ef80a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:44.285090 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-62a2f49b-6c33-4513-b5c6-f18420ef80a4 service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1274731 May 26 14:52:44.357166 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-519a6ee6-f21b-4847-9c94-f1894eea8698 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=57a32134-be1e-490a-ac2e-088e73027408 HTTP/1.1" status: 200 len: 217 time: 0.0645423 May 26 14:52:44.423684 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-e56e34de-0f81-4e7d-a42e-e778c92023f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:44.425007 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-e56e34de-0f81-4e7d-a42e-e778c92023f3 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0613759 May 26 14:52:44.503167 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-62b5a614-8ade-4665-ae4a-1fb7dcaa9364 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:44.504576 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-62b5a614-8ade-4665-ae4a-1fb7dcaa9364 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0723209 May 26 14:52:44.643671 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-d1f2e3e5-43ea-4e75-8e7e-e55e84d3a0a7 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1293647 May 26 14:52:44.877999 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1fc05181-cdf2-461f-9648-3335f810c0fc req-4f2a828b-7a4a-44cc-9754-705b10d012de service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2266383 May 26 14:52:45.159953 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64bf91c3-96d6-4bef-be52-51e1b86aac8c req-62b0ab6c-b16e-4597-9c2e-2501fd4af45c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:45.161289 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-64bf91c3-96d6-4bef-be52-51e1b86aac8c req-62b0ab6c-b16e-4597-9c2e-2501fd4af45c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 944 time: 0.0921898 May 26 14:52:45.207418 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-64bf91c3-96d6-4bef-be52-51e1b86aac8c req-a8e9d75a-7270-4594-9445-bf0c45d98f1b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390017 May 26 14:52:46.416146 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ec77f3-fb06-411e-9658-5332a572c48a req-617c97a3-f579-43fb-ab6d-be6a54a67dfa tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:46.417509 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-23ec77f3-fb06-411e-9658-5332a572c48a req-617c97a3-f579-43fb-ab6d-be6a54a67dfa tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 944 time: 0.0875063 May 26 14:52:46.461437 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-23ec77f3-fb06-411e-9658-5332a572c48a req-3cc0c498-45df-4dc3-ae58-d5261bb0ed6b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381703 May 26 14:52:47.806552 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ae0fc1-2e91-45cc-b9d8-053c85b705dd req-5e711d95-2fe4-4368-92e9-a672c98949a2 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:47.807865 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21ae0fc1-2e91-45cc-b9d8-053c85b705dd req-5e711d95-2fe4-4368-92e9-a672c98949a2 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 944 time: 0.2311785 May 26 14:52:47.853513 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21ae0fc1-2e91-45cc-b9d8-053c85b705dd req-508fdf1e-e92e-4d70-bff7-09ef436fdcbc tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391898 May 26 14:52:49.105091 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3747588c-0fac-4141-8e64-7bc618d467dd req-c9131eb9-850c-4d3b-aa90-6425e84bf1d0 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:49.106588 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3747588c-0fac-4141-8e64-7bc618d467dd req-c9131eb9-850c-4d3b-aa90-6425e84bf1d0 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 944 time: 0.1420455 May 26 14:52:49.161921 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3747588c-0fac-4141-8e64-7bc618d467dd req-fdb79f57-8e0d-4e6a-a84e-06d8045da9e5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393467 May 26 14:52:50.171411 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 57a32134-be1e-490a-ac2e-088e73027408 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:52:50.313841 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 57a32134-be1e-490a-ac2e-088e73027408, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=57a32134-be1e-490a-ac2e-088e73027408,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:52:50.331413 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '57a32134-be1e-490a-ac2e-088e73027408', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1123, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:52:50.352359 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ed26f5-1080-4fcf-81bc-51fba379108e req-d70a9cd1-8f6f-4825-b9b0-a648e71e998b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:50.353800 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21ed26f5-1080-4fcf-81bc-51fba379108e req-d70a9cd1-8f6f-4825-b9b0-a648e71e998b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 944 time: 0.0843575 May 26 14:52:50.386409 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:50.399793 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-21ed26f5-1080-4fcf-81bc-51fba379108e req-0bfa5c87-514b-4b3b-9ed2-5c8a57897ac2 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395713 May 26 14:52:50.403435 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 57a32134-be1e-490a-ac2e-088e73027408 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:52:50.419144 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 57a32134-be1e-490a-ac2e-088e73027408, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=57a32134-be1e-490a-ac2e-088e73027408,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:52:50.423195 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:50.424906 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-9125bee3-3ed5-4981-9542-ddcabd3334b6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:50.490138 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=57a32134-be1e-490a-ac2e-088e73027408,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:50.497583 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.497926 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.498261 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.498620 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.498940 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.499265 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.499584 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.499917 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.500218 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.500539 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.500854 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.501167 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:52:50.504962 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:50.700057 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['57a32134-be1e-490a-ac2e-088e73027408'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:52:51.237111 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:52:51.604772 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b52673-6167-402e-805e-4df34f2ff739 req-13262480-99f1-4c89-82e8-d6752945a207 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:51.606226 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06b52673-6167-402e-805e-4df34f2ff739 req-13262480-99f1-4c89-82e8-d6752945a207 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 945 time: 0.0934711 May 26 14:52:51.646044 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-28bb919b-af7a-4d5b-bb6d-c02d43dc3b47 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:51.656425 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-06b52673-6167-402e-805e-4df34f2ff739 req-d3013728-3b01-41e7-a66f-5a6bd6fbbba1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444024 May 26 14:52:52.176200 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 57a32134-be1e-490a-ac2e-088e73027408 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:52:52.252337 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port 57a32134-be1e-490a-ac2e-088e73027408 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:52:52.257048 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 57a32134-be1e-490a-ac2e-088e73027408 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:52:52.264159 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:52.393652 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:52.421377 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57a32134-be1e-490a-ac2e-088e73027408'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:52:52.431675 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 57a32134-be1e-490a-ac2e-088e73027408, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=57a32134-be1e-490a-ac2e-088e73027408,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:52:52.436315 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:52.438548 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:52.469122 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57a32134-be1e-490a-ac2e-088e73027408', 'code': 200} May 26 14:52:52.512033 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=57a32134-be1e-490a-ac2e-088e73027408,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:52.514974 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:52.830458 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a85e14-febc-4fc3-adef-9e3a3e329f5f req-ea1e0ce3-8298-4fbb-a5bb-43be8954fc66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:52.831897 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5a85e14-febc-4fc3-adef-9e3a3e329f5f req-ea1e0ce3-8298-4fbb-a5bb-43be8954fc66 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 1099 time: 0.1203194 May 26 14:52:52.884077 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-134e300c-1e4a-45c5-9b5d-1c9b519dbaa2 req-d6bd7363-0443-4792-a7a4-85d80505c98b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:52.885475 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-134e300c-1e4a-45c5-9b5d-1c9b519dbaa2 req-d6bd7363-0443-4792-a7a4-85d80505c98b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 946 time: 0.1180673 May 26 14:52:52.888879 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-f5a85e14-febc-4fc3-adef-9e3a3e329f5f req-45135ca2-ed1d-4a51-8459-03dee5100d0c service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492468 May 26 14:52:52.929845 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-134e300c-1e4a-45c5-9b5d-1c9b519dbaa2 req-476a85ed-3d54-4454-a4f7-6ef8c4fda154 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378814 May 26 14:52:53.288490 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-2cbdd649-c1bb-406e-aa9d-4959a9e8c1e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:54.126883 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4e21e0-29be-4d45-9a4a-9cefd51c6901 req-8d732464-abc5-4845-8d07-a52c02248923 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:54.128504 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5d4e21e0-29be-4d45-9a4a-9cefd51c6901 req-8d732464-abc5-4845-8d07-a52c02248923 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 946 time: 0.0866494 May 26 14:52:54.176181 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5d4e21e0-29be-4d45-9a4a-9cefd51c6901 req-36cf9ca6-ddc8-4d4c-8861-d72111a76d03 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418761 May 26 14:52:54.375976 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696a0db7-3b77-400f-aa88-e8153e8c5010 req-2bfbd447-23cc-46ed-acd2-6accf9ba84c5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:54.377604 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-696a0db7-3b77-400f-aa88-e8153e8c5010 req-2bfbd447-23cc-46ed-acd2-6accf9ba84c5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 946 time: 0.0881343 May 26 14:52:54.422478 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-696a0db7-3b77-400f-aa88-e8153e8c5010 req-6999019e-40b2-4d95-8515-3c061a29245f tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390737 May 26 14:52:54.447565 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49160) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:52:54.523029 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d10c6d7f-7454-485f-a47d-89728a988125 tempest-TestVolumeBootPattern-73066992 tempest-TestVolumeBootPattern-73066992-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98444) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:54.524438 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d10c6d7f-7454-485f-a47d-89728a988125 tempest-TestVolumeBootPattern-73066992 tempest-TestVolumeBootPattern-73066992-project-admin] Synchronizing usage tracker for tenant:33d94aeb09de4d84a66010b7eea38bd5 on resource:port {{(pid=98444) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:52:54.543047 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-d10c6d7f-7454-485f-a47d-89728a988125 tempest-TestVolumeBootPattern-73066992 tempest-TestVolumeBootPattern-73066992-project-admin] Unset dirty status for tenant:33d94aeb09de4d84a66010b7eea38bd5 on resource:port {{(pid=98444) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:52:54.544412 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-d10c6d7f-7454-485f-a47d-89728a988125 tempest-TestVolumeBootPattern-73066992 tempest-TestVolumeBootPattern-73066992-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 1094 time: 0.0959098 May 26 14:52:54.547416 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49164) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:52:54.552935 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.v2.base [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address': '172.20.0.10'}} {{(pid=98444) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:52:54.559926 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:52:54.563762 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:floatingip and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:52:54.566694 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.quota.resource [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=98444) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:52:54.573205 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.quota.driver [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=98444) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:52:54.575465 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:54.585777 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:54.727776 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:54.872922 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_common [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Allocated IP 172.27.3.209 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/08abca8e-4afd-41a5-be49-1971c05a316d) {{(pid=98444) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:52:55.139427 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:55.171601 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:55.176106 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-be7c344d-4d1d-4bd6-90d5-c1974a6cc08c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:55.241665 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98444) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:52:55.244539 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.base_scheduler [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources bound (agent type, host, resource id): {{(pid=98444) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:52:55.248281 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Received port after_create {{(pid=98444) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:52:55.285124 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=08abca8e-4afd-41a5-be49-1971c05a316d,revision_number=1']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:55.292276 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:55.679141 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:55.767636 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:55.885182 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:55.922727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:55.983258 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:55.989402 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3085241'] for port, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:55.992965 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7692acf5-ddbb-44e2-9770-15b4d6e8e679 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:52:56.100203 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=08abca8e-4afd-41a5-be49-1971c05a316d,revision_number=2']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:52:56.104175 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:52:56.111099 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:56.284873 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Floating IP 11a536c8-69e6-40f6-a848-0b1b08e8f14f associated. External IP: 172.27.3.209, port: 57a32134-be1e-490a-ac2e-088e73027408. May 26 14:52:56.752982 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Router 39443462-555c-4ab6-8ab8-12514f6596b8 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:52:56.947150 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:52:56.957668 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:52:56.969078 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:52:56.969695 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:52:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:56.972877 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:57.036231 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.4875667 May 26 14:52:57.036877 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'tag': '57a32134-be1e-490a-ac2e-088e73027408'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:52:57.082204 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'tag': '57a32134-be1e-490a-ac2e-088e73027408', 'status': 'completed', 'code': 200} May 26 14:52:57.161838 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:52:57.204116 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8288835f-a88b-47e1-8098-e90f16545da5 req-76d85be3-b961-40f5-8978-09e668502b25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:57.205751 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8288835f-a88b-47e1-8098-e90f16545da5 req-76d85be3-b961-40f5-8978-09e668502b25 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 1099 time: 0.0824685 May 26 14:52:57.338913 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8288835f-a88b-47e1-8098-e90f16545da5 req-c2ea3214-0d59-4e1f-8ed8-2e3631703738 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:57.340570 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8288835f-a88b-47e1-8098-e90f16545da5 req-c2ea3214-0d59-4e1f-8ed8-2e3631703738 service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1289673 May 26 14:52:57.447421 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8288835f-a88b-47e1-8098-e90f16545da5 req-e7436dfc-0cb2-4aec-9994-ddbc5d527b04 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=57a32134-be1e-490a-ac2e-088e73027408 HTTP/1.1" status: 200 len: 1000 time: 0.1008630 May 26 14:52:57.509681 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8288835f-a88b-47e1-8098-e90f16545da5 req-a6e17701-6287-43fc-8f46-293d67192121 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:57.511222 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8288835f-a88b-47e1-8098-e90f16545da5 req-a6e17701-6287-43fc-8f46-293d67192121 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0578678 May 26 14:52:57.532004 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:52:57.550709 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:55Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:57.554679 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:52:57.563027 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:52:57.563637 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:52:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:57.588730 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8288835f-a88b-47e1-8098-e90f16545da5 req-ca96e634-6120-4057-aabf-64644419793f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:57.590288 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8288835f-a88b-47e1-8098-e90f16545da5 req-ca96e634-6120-4057-aabf-64644419793f service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0724883 May 26 14:52:57.721229 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8288835f-a88b-47e1-8098-e90f16545da5 req-86c3526a-c849-4206-91c8-67eca467c9a4 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1244597 May 26 14:52:57.743429 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:52:57.956619 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8288835f-a88b-47e1-8098-e90f16545da5 req-c4597d4b-f906-4c6f-92c8-83b47d5bce4f service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2281473 May 26 14:52:58.100759 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:55Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:52:58.104791 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88abdcbb-09cf-40d6-b983-26c06708fb13 None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:55Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:52:58.297276 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93ebb115-3ee6-4608-84f7-86b895f97adf None None] New status for floating IP 11a536c8-69e6-40f6-a848-0b1b08e8f14f: ACTIVE {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:52:58.590037 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-01213849-a54a-44c5-88da-d3285b012d70 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1178787 May 26 14:52:58.746599 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-d869bdb8-7197-4dcd-8eb8-63d51473cb6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:58.747884 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-d869bdb8-7197-4dcd-8eb8-63d51473cb6d service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1099 time: 0.0754750 May 26 14:52:58.901534 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-9b60bea5-6fc6-452b-9a34-e9ed9fde769e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:58.903085 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-9b60bea5-6fc6-452b-9a34-e9ed9fde769e service neutron] 10.222.0.79 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 911 time: 0.1319625 May 26 14:52:59.006253 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-e342c4fc-6f75-4e8f-aca6-716464c3ba80 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 1002 time: 0.0968146 May 26 14:52:59.071813 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-060480ed-70fe-4ce6-97fd-fb076c097151 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:59.073210 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-060480ed-70fe-4ce6-97fd-fb076c097151 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 200 len: 848 time: 0.0610185 May 26 14:52:59.151410 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-b02dd2d9-3334-4faf-9533-676abc5bcaca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:52:59.152896 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-b02dd2d9-3334-4faf-9533-676abc5bcaca service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0727785 May 26 14:52:59.163754 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-25c6756b-3808-46f7-9f90-bee4b0d42035 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:52:59.164669 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-25c6756b-3808-46f7-9f90-bee4b0d42035 service neutron] 10.222.0.79 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0057933 May 26 14:52:59.317864 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-d134c482-d300-4c7a-b129-f2e77eff1f96 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1463001 May 26 14:52:59.457374 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-713e352b-7271-46c3-ae6c-0c8e64659b54 req-44c721ce-5ea2-46f3-8536-9c4fa3471af0 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1330462 May 26 14:53:21.662291 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3cb3d2c7-e398-4384-b60b-1a18230c5acf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:23.296855 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5f102f43-85a6-4875-aadd-b56905344fd4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:24.586188 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:25.889728 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:25.931795 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:27.515618 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:28.241329 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:53:51.650894 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-742dc0e1-bfe5-40e2-b234-a251727c4d20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:53.291934 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-768992d1-7a93-4779-bdd6-bcf3a95f1f1f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:54.585791 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:55.890852 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:55.928947 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:53:57.518317 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:00.557003 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-5c02021f-5950-4801-b619-c6d1760b4c2a service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0838320 May 26 14:54:00.667337 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-b2eca1ca-3784-4838-a202-82499625b29a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:00.668793 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-b2eca1ca-3784-4838-a202-82499625b29a service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 1099 time: 0.0782921 May 26 14:54:00.825156 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-af42678d-6289-44d9-ab9c-6dfcbc1227e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:00.826612 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-af42678d-6289-44d9-ab9c-6dfcbc1227e9 service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1353176 May 26 14:54:00.927826 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-6925ee4a-8c3e-4479-abca-8ab61c0e4be7 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=57a32134-be1e-490a-ac2e-088e73027408 HTTP/1.1" status: 200 len: 1002 time: 0.0951431 May 26 14:54:01.005765 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-bda58da7-d22c-4242-ab14-050dfc577072 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:01.007291 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-bda58da7-d22c-4242-ab14-050dfc577072 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0730362 May 26 14:54:01.093603 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-fbea3ceb-bf1c-45df-b3e5-bdee43de2ac8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:01.095828 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-fbea3ceb-bf1c-45df-b3e5-bdee43de2ac8 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0814457 May 26 14:54:01.234096 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-60b25fe5-ec2c-4327-8087-8b4b7c417953 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1317639 May 26 14:54:01.465577 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7faadb13-5fba-4524-9c69-c6d97133d826 req-ac1836ea-8494-47cf-9a27-4d76fdaf1d3d service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2244520 May 26 14:54:05.245692 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:54:08.510129 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb19a353-f74b-4493-8196-9413ed29a306 req-577b1411-abb1-4a53-80ce-99df6782a6fa tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:08.511626 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb19a353-f74b-4493-8196-9413ed29a306 req-577b1411-abb1-4a53-80ce-99df6782a6fa tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0850384 May 26 14:54:08.560843 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb19a353-f74b-4493-8196-9413ed29a306 req-40162b59-86f6-4fae-85c8-98d076ca09a5 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408676 May 26 14:54:09.764485 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fcbd95-aef3-493c-9ec2-a13fb1780061 req-2371ecae-33df-4b11-bc4c-80c7e2eec735 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:09.765942 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e3fcbd95-aef3-493c-9ec2-a13fb1780061 req-2371ecae-33df-4b11-bc4c-80c7e2eec735 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0947397 May 26 14:54:09.813324 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e3fcbd95-aef3-493c-9ec2-a13fb1780061 req-20bcc6ec-2449-4f7f-85bf-e0e251d50b35 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414069 May 26 14:54:11.020712 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81c700d-dc57-4930-853e-7fe7cc243223 req-f53dd99d-3d5a-4801-910f-ffeb2a91bd6f tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:11.022197 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d81c700d-dc57-4930-853e-7fe7cc243223 req-f53dd99d-3d5a-4801-910f-ffeb2a91bd6f tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0819199 May 26 14:54:11.071020 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d81c700d-dc57-4930-853e-7fe7cc243223 req-03deceeb-86ce-46c3-becf-10646a78e302 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402420 May 26 14:54:12.274817 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9089e161-2145-4f34-a539-1beca7ca34a7 req-23076643-8a53-4c21-aff7-fd81e562b5a4 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:12.276306 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9089e161-2145-4f34-a539-1beca7ca34a7 req-23076643-8a53-4c21-aff7-fd81e562b5a4 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0885396 May 26 14:54:12.321413 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9089e161-2145-4f34-a539-1beca7ca34a7 req-1a55166b-e5b5-49cd-b3ca-ac8f8bc06182 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391676 May 26 14:54:13.531281 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0b11c36-05d1-49d6-b923-047fbef6da37 req-5476ff70-3d01-4a3e-a9f1-b70ac67c6f20 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:13.532743 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e0b11c36-05d1-49d6-b923-047fbef6da37 req-5476ff70-3d01-4a3e-a9f1-b70ac67c6f20 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0923946 May 26 14:54:13.581736 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e0b11c36-05d1-49d6-b923-047fbef6da37 req-c578cad4-719a-4745-9743-80bf8a6ad5e1 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433087 May 26 14:54:14.772740 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb0c481-08d8-4bac-916a-a837b365c352 req-4eaca5b5-f40d-4601-91bb-be50aed89e9c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:14.774217 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ffb0c481-08d8-4bac-916a-a837b365c352 req-4eaca5b5-f40d-4601-91bb-be50aed89e9c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0850208 May 26 14:54:14.818250 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ffb0c481-08d8-4bac-916a-a837b365c352 req-7fb12530-8287-404e-ba8b-8bfe8e9cad7b tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380297 May 26 14:54:16.029826 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d609d693-4f8a-4063-8a85-f18648101d24 req-b71c3ed9-dd45-4a33-94b1-e8b4e11c888e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:16.031322 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d609d693-4f8a-4063-8a85-f18648101d24 req-b71c3ed9-dd45-4a33-94b1-e8b4e11c888e tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0896380 May 26 14:54:16.079360 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d609d693-4f8a-4063-8a85-f18648101d24 req-cec78ec7-3585-4e5c-bfe4-bd068358123b tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395610 May 26 14:54:17.282437 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b179158-de1f-4587-a802-33cda782b73b req-e4ae7821-280b-48e7-afc7-df284b788ace tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:17.283889 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2b179158-de1f-4587-a802-33cda782b73b req-e4ae7821-280b-48e7-afc7-df284b788ace tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0946412 May 26 14:54:17.330285 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2b179158-de1f-4587-a802-33cda782b73b req-b5ea3c2e-55c6-456f-8bb5-3017e80affc8 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406933 May 26 14:54:18.543097 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67be404a-d16b-4426-8e31-acb3ea629735 req-07f10dda-f798-4180-8a8b-ef878f5889b2 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:18.544537 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-67be404a-d16b-4426-8e31-acb3ea629735 req-07f10dda-f798-4180-8a8b-ef878f5889b2 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0989213 May 26 14:54:18.599777 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-67be404a-d16b-4426-8e31-acb3ea629735 req-6d66f3db-f23b-48e0-8564-94f9640c42a2 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469286 May 26 14:54:18.710682 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-4869b2d6-c4c8-4bc4-9d7a-ca060b6fa6bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:18.712101 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-4869b2d6-c4c8-4bc4-9d7a-ca060b6fa6bd service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1099 time: 0.0800455 May 26 14:54:18.843393 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-2a4da531-456b-44fe-b342-ca79430c6629 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:18.844837 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-2a4da531-456b-44fe-b342-ca79430c6629 service neutron] 10.222.0.79 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 911 time: 0.1262536 May 26 14:54:18.961060 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-e077545e-9a49-496d-be03-f79f5b62fbbd service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 1002 time: 0.1097863 May 26 14:54:19.027710 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-66aeb927-b216-462f-b22a-413ebb5af7b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:19.029171 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-66aeb927-b216-462f-b22a-413ebb5af7b2 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 200 len: 848 time: 0.0621037 May 26 14:54:19.106774 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-99d481e8-7540-4b50-8b33-2320dd8450e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:19.108239 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-99d481e8-7540-4b50-8b33-2320dd8450e6 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0728469 May 26 14:54:19.237225 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-7f87329e-5615-41c9-9279-26c9facc2d60 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1218550 May 26 14:54:19.468797 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a1fdf284-4c92-4002-bf91-6d5f34f09fd7 req-124ea0ac-98ad-456f-ac6e-fdecf8e1287e service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2250645 May 26 14:54:19.807766 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810a56be-9174-4101-b7d2-a177b485457c req-3dfd797f-7f2d-4f14-a03f-24f87385d8f2 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:19.809274 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-810a56be-9174-4101-b7d2-a177b485457c req-3dfd797f-7f2d-4f14-a03f-24f87385d8f2 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0921235 May 26 14:54:19.854917 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-810a56be-9174-4101-b7d2-a177b485457c req-d32d375d-6ca1-482c-b626-9ef7947097dd tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400558 May 26 14:54:21.066016 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207a8c83-3c1b-4905-931b-6730c9289cff req-c70354fc-c9ef-44d3-90b6-b62abe9e9472 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:21.067677 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-207a8c83-3c1b-4905-931b-6730c9289cff req-c70354fc-c9ef-44d3-90b6-b62abe9e9472 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0930276 May 26 14:54:21.119533 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-207a8c83-3c1b-4905-931b-6730c9289cff req-7dd2cf15-2e45-4c5a-984b-3a867bf07560 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405736 May 26 14:54:21.644052 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-3936ef9d-b28e-48ab-aec3-19916acc799c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:22.317267 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ef7876-fa7a-4686-8c85-5ec4d2b2777f req-d1cea381-d054-4ff0-ad80-8e70dcdc50d9 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:22.318735 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-08ef7876-fa7a-4686-8c85-5ec4d2b2777f req-d1cea381-d054-4ff0-ad80-8e70dcdc50d9 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0924389 May 26 14:54:22.364300 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-08ef7876-fa7a-4686-8c85-5ec4d2b2777f req-6bf44f3b-cd4a-48c0-9c8d-7f31e0845e97 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391302 May 26 14:54:22.707752 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-b81e820c-047b-4118-af49-195b9359006a service neutron] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1167555 May 26 14:54:22.725148 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8245c7d-32e4-445c-ab5f-c77fbc69f4d7 req-ae48c22b-ee6f-4d15-86c2-e0354ba05c5d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:22.726634 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c8245c7d-32e4-445c-ab5f-c77fbc69f4d7 req-ae48c22b-ee6f-4d15-86c2-e0354ba05c5d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0794916 May 26 14:54:22.771221 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c8245c7d-32e4-445c-ab5f-c77fbc69f4d7 req-d6f52cce-a20d-4882-add7-f53cd02c445f tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387924 May 26 14:54:23.286946 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-303daa1b-2305-4ea3-99b1-28e3e0f7c1e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:23.960808 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf64a83-f9d0-40ab-bf36-0cb4425e74bf req-ab62355d-6bec-4fd4-a3d4-1ad51caf39df tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:23.962283 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5bf64a83-f9d0-40ab-bf36-0cb4425e74bf req-ab62355d-6bec-4fd4-a3d4-1ad51caf39df tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0832927 May 26 14:54:24.007254 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5bf64a83-f9d0-40ab-bf36-0cb4425e74bf req-bea44274-e835-45fc-bf75-b742f5659ee5 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388963 May 26 14:54:24.592776 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:24.756649 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9403c520-1819-4993-a16e-95666e206ccd req-a1a5e909-449e-46c3-998a-f4ad19daec56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:24.758156 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-a1a5e909-449e-46c3-998a-f4ad19daec56 service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51&tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5 HTTP/1.1" status: 200 len: 1099 time: 0.0793366 May 26 14:54:24.868262 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9403c520-1819-4993-a16e-95666e206ccd req-f8e5ec97-0ce1-42c6-bd35-35393cdd3054 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:24.869747 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-f8e5ec97-0ce1-42c6-bd35-35393cdd3054 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1099 time: 0.0793343 May 26 14:54:25.014506 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9403c520-1819-4993-a16e-95666e206ccd req-b0e1fb26-b44b-4b72-b963-11af79bd5bef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:25.015860 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-b0e1fb26-b44b-4b72-b963-11af79bd5bef service neutron] 10.222.0.79 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 911 time: 0.1397197 May 26 14:54:25.120997 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-dc1aa8ce-9d55-4e51-9e83-fa3dd6c6e0ad service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 1002 time: 0.0983124 May 26 14:54:25.229661 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9403c520-1819-4993-a16e-95666e206ccd req-62dc33a1-4795-4c3b-ab9c-b2c58a3e0cd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:25.231156 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-62dc33a1-4795-4c3b-ab9c-b2c58a3e0cd7 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 200 len: 848 time: 0.0789094 May 26 14:54:25.298806 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be5e4582-28ea-49fb-b10c-c1abd40e4c15 req-19957557-affd-48d9-a2d8-6f0b85b7c6dc tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:25.300153 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-be5e4582-28ea-49fb-b10c-c1abd40e4c15 req-19957557-affd-48d9-a2d8-6f0b85b7c6dc tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.1782858 May 26 14:54:25.353262 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-be5e4582-28ea-49fb-b10c-c1abd40e4c15 req-2a18d370-d73c-4bf6-a380-07d0a3d8874f tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461473 May 26 14:54:25.357630 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9403c520-1819-4993-a16e-95666e206ccd req-2300b344-de9d-4f1e-80d5-2e1ae3963307 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:25.359052 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-2300b344-de9d-4f1e-80d5-2e1ae3963307 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1200731 May 26 14:54:25.507898 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-7cea378d-0961-46e2-9a98-4fe365184394 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1423426 May 26 14:54:25.636308 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9403c520-1819-4993-a16e-95666e206ccd req-f310126a-defa-43fc-9849-feaf5eede5e6 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1219308 May 26 14:54:25.892863 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:25.932415 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:26.563990 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0dcdf9-483b-4d76-91b1-5022e7989f78 req-3e764966-c5ed-47f7-96c5-c357e6d92297 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:26.565403 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3f0dcdf9-483b-4d76-91b1-5022e7989f78 req-3e764966-c5ed-47f7-96c5-c357e6d92297 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0940864 May 26 14:54:26.608961 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3f0dcdf9-483b-4d76-91b1-5022e7989f78 req-f668c470-ab4f-4a45-ac99-b00e6d066595 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378959 May 26 14:54:26.639166 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 75cc186e-5074-4469-92d5-751dfabe82ec no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:54:26.752571 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:26.779941 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:54:26.790002 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:54:26.796003 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:26.798868 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:26.889498 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec', 'code': 200} May 26 14:54:26.908382 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=6']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:26.915865 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.916213 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.916549 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.916876 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.917200 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.917542 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.917859 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.918173 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.918525 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.918932 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.919202 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.919518 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:26.923346 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:27.525911 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:27.815372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad073362-753e-4f2f-84cb-8807d83fd523 req-125441f9-63ba-47bb-8ba3-700b58b9016d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:27.816758 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ad073362-753e-4f2f-84cb-8807d83fd523 req-125441f9-63ba-47bb-8ba3-700b58b9016d tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0868268 May 26 14:54:27.964370 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-ad073362-753e-4f2f-84cb-8807d83fd523 req-652089cf-0267-4604-8e75-fce8a7b50777 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1389196 May 26 14:54:29.171991 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5fb6b3c-b3a6-423f-80a5-490542ac545e req-399f65fe-a550-4d88-8f06-94fbe0a9032b tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:29.173461 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a5fb6b3c-b3a6-423f-80a5-490542ac545e req-399f65fe-a550-4d88-8f06-94fbe0a9032b tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0922174 May 26 14:54:29.222552 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a5fb6b3c-b3a6-423f-80a5-490542ac545e req-b5c09e46-876b-4160-ba4a-8855c6f38618 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430536 May 26 14:54:30.443360 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30a9c54-de1e-46ba-92fe-99cd1945b892 req-4ac8fe85-9c1d-4539-b029-a20c589bf2d9 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:30.444678 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b30a9c54-de1e-46ba-92fe-99cd1945b892 req-4ac8fe85-9c1d-4539-b029-a20c589bf2d9 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0974185 May 26 14:54:30.494187 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b30a9c54-de1e-46ba-92fe-99cd1945b892 req-4d58f2ed-bb28-4a82-be6e-f52db183ad3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404449 May 26 14:54:31.695167 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43a9661-3ee0-43ef-856d-aa326db4ba6f req-27a27368-9d33-4294-a9fd-6ff2b4ec9093 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:31.696626 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d43a9661-3ee0-43ef-856d-aa326db4ba6f req-27a27368-9d33-4294-a9fd-6ff2b4ec9093 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0820439 May 26 14:54:31.742618 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d43a9661-3ee0-43ef-856d-aa326db4ba6f req-5e44cae9-0960-4f9c-92b6-cd2016b025bf tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396512 May 26 14:54:31.864092 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8391ca6-d32e-4c1f-abfb-01d0aae611f8 req-900aa7e4-79bd-46e8-8ea3-f72b825eb3de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:31.865466 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a8391ca6-d32e-4c1f-abfb-01d0aae611f8 req-900aa7e4-79bd-46e8-8ea3-f72b825eb3de service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1097 time: 0.0850298 May 26 14:54:31.907698 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a8391ca6-d32e-4c1f-abfb-01d0aae611f8 req-ed6e0fcb-7b5f-4f7b-b35a-2107a4182cf4 service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0359347 May 26 14:54:32.950097 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c415c95b-0b6c-4c07-a302-ccb873efe8dd req-6be5c732-51fe-4ace-8825-39d4811af32b tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:32.951630 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c415c95b-0b6c-4c07-a302-ccb873efe8dd req-6be5c732-51fe-4ace-8825-39d4811af32b tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0935130 May 26 14:54:32.999153 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c415c95b-0b6c-4c07-a302-ccb873efe8dd req-3506d9d7-23d6-4b91-9db2-d1c500ac68d5 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417635 May 26 14:54:34.213524 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be60917-b3ae-4fec-93ff-42073ea86665 req-7ca9d104-34b3-4ea9-89bc-705bdcb3aec1 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:34.214993 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5be60917-b3ae-4fec-93ff-42073ea86665 req-7ca9d104-34b3-4ea9-89bc-705bdcb3aec1 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 944 time: 0.0916681 May 26 14:54:34.260888 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5be60917-b3ae-4fec-93ff-42073ea86665 req-be39e1e8-86fb-46ce-be69-adf8f8332792 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400429 May 26 14:54:35.126840 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 75cc186e-5074-4469-92d5-751dfabe82ec details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:54:35.261062 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:54:35.276484 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': '75cc186e-5074-4469-92d5-751dfabe82ec', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'port_id': '75cc186e-5074-4469-92d5-751dfabe82ec', 'mac_address': 'fa:16:3e:55:ce:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:54:35.343668 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:35.364267 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75cc186e-5074-4469-92d5-751dfabe82ec {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:54:35.383952 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:54:35.389029 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:35.393080 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-947fa5dc-2db4-4ed5-9e98-5bcc862d5725 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:35.476262 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=7']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:35.480606 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:35.483933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd22c72f-1bea-4f08-b6d0-eb770cbcae31 req-0920d2b2-26ab-42bc-8988-126fdcb739d4 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:35.485502 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fd22c72f-1bea-4f08-b6d0-eb770cbcae31 req-0920d2b2-26ab-42bc-8988-126fdcb739d4 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 945 time: 0.1093760 May 26 14:54:35.534519 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fd22c72f-1bea-4f08-b6d0-eb770cbcae31 req-4fbe2282-42aa-4811-8a65-0446eda36851 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429306 May 26 14:54:35.754973 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['75cc186e-5074-4469-92d5-751dfabe82ec'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:54:36.740784 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98414fac-c255-4fe5-9552-d079de211c26 req-276fa5b4-d23f-4c86-9d3b-fe688f0882a2 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:36.742263 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98414fac-c255-4fe5-9552-d079de211c26 req-276fa5b4-d23f-4c86-9d3b-fe688f0882a2 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 945 time: 0.0941019 May 26 14:54:36.788569 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-98414fac-c255-4fe5-9552-d079de211c26 req-0d7b7821-095d-4893-bef6-f079ba997588 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403636 May 26 14:54:38.191403 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 75cc186e-5074-4469-92d5-751dfabe82ec up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:54:38.265727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port 75cc186e-5074-4469-92d5-751dfabe82ec triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:54:38.266117 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:38.386558 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:38.413281 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:54:38.423510 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:54:38.428430 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:38.430512 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:38.467728 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec', 'code': 200} May 26 14:54:38.501761 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=8']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:38.504987 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:39.704782 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-545ffea2-759a-445f-8f58-efeef55ac659 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1100445324&fields=id&tenant_id=054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 267 time: 0.0471253 May 26 14:54:39.856515 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-d1a0d9d0-5080-4a93-8482-1cb317fed6ab tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:39.857939 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-d1a0d9d0-5080-4a93-8482-1cb317fed6ab tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 811 time: 0.1441686 May 26 14:54:39.878801 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-f5cc2923-ae3a-4345-ac60-fae70e1e4b6c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/quotas/054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 375 time: 0.0150414 May 26 14:54:39.975272 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-19053526-e992-4bd6-8f81-4a5ad8b697b6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0913308 May 26 14:54:40.040128 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-215e3acc-2ef3-4a81-89d8-ab1e5cf2bdf8 service neutron] http://10.222.0.72:9696/v2.0/extensions returned with HTTP 200 {{(pid=98445) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 26 14:54:40.041093 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-215e3acc-2ef3-4a81-89d8-ab1e5cf2bdf8 service neutron] 10.222.0.72 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0543268 May 26 14:54:40.174620 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-34f9b125-12da-4939-a1ec-8f3cbd02a700 service neutron] 10.222.0.72 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1275034 May 26 14:54:40.311479 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-396d428f-87b0-4f7e-b6ca-b75ea546e7e3 service neutron] 10.222.0.72 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281052 May 26 14:54:40.736446 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-87e5cce4-aec0-4d1b-9bdd-ae1990b4ad6a req-60684fde-1234-4f3f-ae81-8cc8430cdad5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 210 time: 0.0462630 May 26 14:54:41.899919 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-eef83000-459f-4561-b82d-500842c230fd req-1eb47e9e-9633-40b4-a8bd-692cc4bcf5c0 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 210 time: 0.0528197 May 26 14:54:41.943795 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-3314d2c7-72b1-4093-8228-a46aa8eedb72 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:41.945211 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-3314d2c7-72b1-4093-8228-a46aa8eedb72 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 811 time: 0.1837184 May 26 14:54:41.999322 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-cda71b76-8228-4683-98d5-ccea9830fd21 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=054087186333487b82b9a7a12d02c80f HTTP/1.1" status: 200 len: 380 time: 0.0400133 May 26 14:54:42.011559 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'port': {'device_id': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'admin_state_up': True, 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'security_groups': ['ccbc02f3-8afe-463e-99ee-7fa02c671594']}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:54:42.244546 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:54:42.247907 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:54:42.257677 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:54:42.269829 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Made reservation on behalf of 054087186333487b82b9a7a12d02c80f for: {'port': 1} {{(pid=98445) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 26 14:54:42.273372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:42.437075 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Allocated IP 172.20.0.9 (0a3b5429-9434-492a-ba57-3dfc671d164c/be983207-7be6-448d-b3eb-3c77c2c0eda1/b8a212cb-e171-4e5a-84df-897c59538b31) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:54:42.648175 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:42.664651 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Transition to ACTIVE for port object b8a212cb-e171-4e5a-84df-897c59538b31 will not be triggered until provisioned by entity DHCP. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:54:42.689795 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:42.695919 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-5b0ecf80-930f-4ef3-ab43-9bec583406b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:42.764135 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Network 0a3b5429-9434-492a-ba57-3dfc671d164c is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:54:42.765349 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:54:42.769420 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:54:42.815641 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=b8a212cb-e171-4e5a-84df-897c59538b31,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:42.831624 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.832004 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.832368 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.832732 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.833091 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.833449 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.833800 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.834151 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.834534 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.834886 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.835238 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.835583 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:54:42.841135 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:42.854103 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:42.854790 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:42.885661 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b2e21b4e-cec9-4768-bbb1-c06c8260daa1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8776166 May 26 14:54:42.910628 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Request body: {'port': {'device_id': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77459'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:54:43.035471 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-60771513-d9e9-4c00-9d71-121e76404133 None None] Provisioning for port b8a212cb-e171-4e5a-84df-897c59538b31 completed by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:54:43.040079 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-60771513-d9e9-4c00-9d71-121e76404133 None None] Provisioning complete for port b8a212cb-e171-4e5a-84df-897c59538b31 triggered by entity DHCP. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:54:43.040457 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-60771513-d9e9-4c00-9d71-121e76404133 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:43.063940 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:43.093260 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-60771513-d9e9-4c00-9d71-121e76404133 None None] Port b8a212cb-e171-4e5a-84df-897c59538b31 cannot update to ACTIVE because it is not bound. {{(pid=98446) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 26 14:54:43.204306 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152a0ca4-0b56-4632-955d-44067ce8ada0 req-a214a477-a01f-4201-9e86-733cc5d0b13c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:43.204923 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-152a0ca4-0b56-4632-955d-44067ce8ada0 req-a214a477-a01f-4201-9e86-733cc5d0b13c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Synchronizing usage tracker for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:54:43.244687 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-152a0ca4-0b56-4632-955d-44067ce8ada0 req-a214a477-a01f-4201-9e86-733cc5d0b13c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Unset dirty status for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:54:43.245878 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-152a0ca4-0b56-4632-955d-44067ce8ada0 req-a214a477-a01f-4201-9e86-733cc5d0b13c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 931 time: 0.2376971 May 26 14:54:43.377638 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-152a0ca4-0b56-4632-955d-44067ce8ada0 req-b785ae48-8f44-44e2-80c2-e36f1beb787f tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1150513 May 26 14:54:43.474934 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b8a212cb-e171-4e5a-84df-897c59538b31 {{(pid=98445) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:54:43.482339 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:43.497081 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.provisioning_blocks [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Transition to ACTIVE for port object b8a212cb-e171-4e5a-84df-897c59538b31 will not be triggered until provisioned by entity L2. {{(pid=98445) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 26 14:54:43.503573 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:43.507214 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-28bbad6e-2f25-4e00-a0d3-e6b82fe1855c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:43.635104 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Pushing event updated for resources: {'Port': ['ID=b8a212cb-e171-4e5a-84df-897c59538b31,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:43.661613 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:43.739594 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Attempting to bind port b8a212cb-e171-4e5a-84df-897c59538b31 on host hv-cinder-77459 for vnic_type normal with profile {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 26 14:54:43.739813 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Attempting to bind port b8a212cb-e171-4e5a-84df-897c59538b31 by drivers openvswitch,hyperv on host hv-cinder-77459 at level 0 using segments [{'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 26 14:54:43.740154 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Attempting to bind port b8a212cb-e171-4e5a-84df-897c59538b31 on network 0a3b5429-9434-492a-ba57-3dfc671d164c {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:54:43.744788 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Port b8a212cb-e171-4e5a-84df-897c59538b31 on network 0a3b5429-9434-492a-ba57-3dfc671d164c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77459 {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 26 14:54:43.745104 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Attempting to bind port b8a212cb-e171-4e5a-84df-897c59538b31 on network 0a3b5429-9434-492a-ba57-3dfc671d164c {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 26 14:54:43.750220 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Checking agent: {'id': '36d36129-9616-4eca-af0f-95a023e49165', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77459', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'started_at': datetime.datetime(2021, 5, 26, 14, 40, 54), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 54, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 26 14:54:43.750582 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Checking segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98445) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 26 14:54:43.750964 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Bound using segment: {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'} {{(pid=98445) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 26 14:54:43.751382 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.managers [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Bound port: b8a212cb-e171-4e5a-84df-897c59538b31, host: hv-cinder-77459, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '38634d8d-479e-4c5f-9c7f-980524b5596f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1123, 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c'}}] {{(pid=98445) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 26 14:54:43.751720 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:43.842895 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] For port b8a212cb-e171-4e5a-84df-897c59538b31, host hv-cinder-77459, cleared binding levels {{(pid=98445) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 26 14:54:43.845812 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] For port b8a212cb-e171-4e5a-84df-897c59538b31, host hv-cinder-77459, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=b8a212cb-e171-4e5a-84df-897c59538b31,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98445) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 26 14:54:43.852311 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:43.855958 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1ae1c680-eb75-48e2-b6fb-db71d16de49e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:43.912114 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:43.912763 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:43.913995 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] 10.222.0.79 "PUT /v2.0/ports/b8a212cb-e171-4e5a-84df-897c59538b31 HTTP/1.1" status: 200 len: 1093 time: 1.0078423 May 26 14:54:43.914534 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:54:43.936731 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Pushing event updated for resources: {'Port': ['ID=b8a212cb-e171-4e5a-84df-897c59538b31,revision_number=3']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:43.941312 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-1a61e021-7ec6-424b-805a-9850088e0c5d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:44.140002 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'status': 'completed', 'code': 200} May 26 14:54:44.163334 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b36a18fd-bcc1-4064-80fb-eee3f8869584 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:44.164821 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-b36a18fd-bcc1-4064-80fb-eee3f8869584 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 1096 time: 0.1872950 May 26 14:54:44.243774 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-64fceaac-3f4a-43fb-bae4-001d0071f61a service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b8a212cb-e171-4e5a-84df-897c59538b31 HTTP/1.1" status: 200 len: 217 time: 0.0652156 May 26 14:54:44.310615 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-c37b6ab3-0107-4186-b273-984c0bb68624 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:44.312091 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-c37b6ab3-0107-4186-b273-984c0bb68624 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0627346 May 26 14:54:44.390348 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-c57d5aba-f01d-4ff8-a77e-606752a4d6c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:44.391818 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-c57d5aba-f01d-4ff8-a77e-606752a4d6c1 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0734923 May 26 14:54:44.576828 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-9cacd904-2c40-4c68-b0d1-bc12b959d324 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1780612 May 26 14:54:44.678766 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2906f289-d7e7-4d74-af95-bd0bd00398f5 req-c8cb126e-cb3b-4ba0-89a9-d6afa09ab86c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:44.680315 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2906f289-d7e7-4d74-af95-bd0bd00398f5 req-c8cb126e-cb3b-4ba0-89a9-d6afa09ab86c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 943 time: 0.1968181 May 26 14:54:44.755147 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-cecdb251-1543-4882-b2d2-7cc1f0e48cb7 req-ae904d96-689b-4870-80a3-0a4838169058 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1703651 May 26 14:54:44.759701 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-2906f289-d7e7-4d74-af95-bd0bd00398f5 req-efab560a-447f-4db8-b4f9-144325260d90 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0720487 May 26 14:54:44.916047 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-1ef95bc2-2021-4918-bce6-444357232717 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:44.917501 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-1ef95bc2-2021-4918-bce6-444357232717 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 1096 time: 0.0723927 May 26 14:54:45.062337 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-512748e0-2237-44e2-a6ba-5d46a08bd420 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:45.063785 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-512748e0-2237-44e2-a6ba-5d46a08bd420 service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1332934 May 26 14:54:45.137285 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-ef791a9b-8b52-430b-933d-bbd7063b472f service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b8a212cb-e171-4e5a-84df-897c59538b31 HTTP/1.1" status: 200 len: 217 time: 0.0652511 May 26 14:54:45.207920 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-bf19173d-4cf0-4f4e-a973-f234d285fdfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:45.209326 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-bf19173d-4cf0-4f4e-a973-f234d285fdfb service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0631068 May 26 14:54:45.306012 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-cc4a0799-1750-41b2-821e-5c6cff792933 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:45.308352 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-cc4a0799-1750-41b2-821e-5c6cff792933 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0834146 May 26 14:54:45.452013 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-90750c4b-c210-4f76-af63-edac9acbcb61 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1339438 May 26 14:54:45.590234 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-0c225cf6-e50c-42ed-8659-278ec15a6e42 req-98903379-2680-417c-a7e2-c40a834b1749 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1315048 May 26 14:54:45.972471 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2ecfb7-98cf-4998-99be-9f23a23a2450 req-d3045680-60a4-4bd7-93ca-1201dfc87ccc tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:45.973820 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6a2ecfb7-98cf-4998-99be-9f23a23a2450 req-d3045680-60a4-4bd7-93ca-1201dfc87ccc tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 943 time: 0.0930984 May 26 14:54:46.018583 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6a2ecfb7-98cf-4998-99be-9f23a23a2450 req-bff37c05-539f-4b42-86f7-0229e15614e0 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387690 May 26 14:54:47.294264 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be9028bb-cd80-4981-b98c-867f2d5ca26b req-6f56b1f0-eb2b-46a1-9ed2-1750784a06ab tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:47.295745 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-be9028bb-cd80-4981-b98c-867f2d5ca26b req-6f56b1f0-eb2b-46a1-9ed2-1750784a06ab tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 943 time: 0.0958092 May 26 14:54:47.341614 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-be9028bb-cd80-4981-b98c-867f2d5ca26b req-4c0e08df-3147-43ed-b6cc-941cee123d7b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400007 May 26 14:54:48.533999 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b6b335c-4739-4568-a5ee-1bd5298ea6b4 req-c6101a31-09a7-4212-9be5-91b391d3b883 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:48.535514 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7b6b335c-4739-4568-a5ee-1bd5298ea6b4 req-c6101a31-09a7-4212-9be5-91b391d3b883 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 943 time: 0.0838790 May 26 14:54:48.580517 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7b6b335c-4739-4568-a5ee-1bd5298ea6b4 req-2d9666b6-7782-411f-9a81-d75b81b88ad4 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391526 May 26 14:54:49.883303 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a111cd3-56db-4a09-9a4d-b8140ad6df04 req-f0db4118-0beb-4e2e-88c5-8172eb529ba7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:49.884736 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a111cd3-56db-4a09-9a4d-b8140ad6df04 req-f0db4118-0beb-4e2e-88c5-8172eb529ba7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 943 time: 0.1869266 May 26 14:54:49.934420 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a111cd3-56db-4a09-9a4d-b8140ad6df04 req-0c6f2117-fb3a-488f-9f7c-bf1b2683d73e tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438273 May 26 14:54:51.140360 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6334d4a4-713d-44ba-a1d9-5652986b298e req-32cb9108-d817-4c79-8914-a7d56828fbfa tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:51.141831 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6334d4a4-713d-44ba-a1d9-5652986b298e req-32cb9108-d817-4c79-8914-a7d56828fbfa tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 943 time: 0.0913522 May 26 14:54:51.187487 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-6334d4a4-713d-44ba-a1d9-5652986b298e req-738ee188-e5b8-45c2-856a-f4ac682529bd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395005 May 26 14:54:51.654968 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-d4fb4362-38c9-4e1f-ac2f-2bd38d4bffac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:52.280936 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device b8a212cb-e171-4e5a-84df-897c59538b31 details requested by agent hyperv_hv-cinder-77459 with host hv-cinder-77459 {{(pid=98446) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 26 14:54:52.387912 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9faf39da-1b10-4b68-9011-256484f4b0bc req-938c8518-7932-4455-8f99-5044aae8f09f tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:52.389425 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9faf39da-1b10-4b68-9011-256484f4b0bc req-938c8518-7932-4455-8f99-5044aae8f09f tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 943 time: 0.0826731 May 26 14:54:52.419895 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port b8a212cb-e171-4e5a-84df-897c59538b31, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=b8a212cb-e171-4e5a-84df-897c59538b31,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:54:52.434050 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9faf39da-1b10-4b68-9011-256484f4b0bc req-7b47075c-79b4-4d66-aa43-a2a43c3450f0 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386140 May 26 14:54:52.437222 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Returning: {'device': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'port_id': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'mac_address': 'fa:16:3e:7c:d2:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1123, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98446) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 26 14:54:52.491727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:52.508210 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b8a212cb-e171-4e5a-84df-897c59538b31 {{(pid=98446) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 26 14:54:52.523754 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port b8a212cb-e171-4e5a-84df-897c59538b31, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=b8a212cb-e171-4e5a-84df-897c59538b31,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:54:52.529825 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:52.532796 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:52.598199 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=b8a212cb-e171-4e5a-84df-897c59538b31,revision_number=4']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:52.601789 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:52.870829 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] get_ports_and_sgs() called for port_ids ['b8a212cb-e171-4e5a-84df-897c59538b31'] {{(pid=98446) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 26 14:54:53.301660 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-b95397d7-8362-4bf0-9b79-1b79e9c5471d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:53.637522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d121bde-4bed-4a0d-bea0-558ed0134b48 req-16f93719-3e24-409f-94bb-b1d8d4e07dc7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:53.639019 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3d121bde-4bed-4a0d-bea0-558ed0134b48 req-16f93719-3e24-409f-94bb-b1d8d4e07dc7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 944 time: 0.0924654 May 26 14:54:53.685050 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-3d121bde-4bed-4a0d-bea0-558ed0134b48 req-63e4b821-92cb-4c22-9f6b-00ea9624af7f tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401502 May 26 14:54:54.285120 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device b8a212cb-e171-4e5a-84df-897c59538b31 up at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 26 14:54:54.365476 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning for port b8a212cb-e171-4e5a-84df-897c59538b31 completed by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 26 14:54:54.370186 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.provisioning_blocks [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Provisioning complete for port b8a212cb-e171-4e5a-84df-897c59538b31 triggered by entity L2. {{(pid=98446) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 26 14:54:54.370600 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7672556'] for port, provisioning_complete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:54.492512 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:54.521344 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31'}] {{(pid=98446) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:54:54.531756 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] For port b8a212cb-e171-4e5a-84df-897c59538b31, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=b8a212cb-e171-4e5a-84df-897c59538b31,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:54:54.537225 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711'] for port, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:54.539259 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-615a0a75-aee2-4ed9-872c-e26e594aec61 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:54.570072 dv-cinder-774594-6-iscsi neutron-server[98446]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'code': 200} May 26 14:54:54.637752 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:54.652706 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Pushing event updated for resources: {'Port': ['ID=b8a212cb-e171-4e5a-84df-897c59538b31,revision_number=5']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:54.655601 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:54.933674 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9475a3-0124-45d7-8e6e-0214d54b0d98 req-12899833-9ab9-4225-9769-18cdf01b527b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:54.935037 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c9475a3-0124-45d7-8e6e-0214d54b0d98 req-12899833-9ab9-4225-9769-18cdf01b527b tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 945 time: 0.1355510 May 26 14:54:54.937600 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529c6833-ce05-42c3-ba86-bcd2f6557183 req-7e8ac922-50f3-49e9-b4c2-e1a16f3c5c9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:54.938943 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-529c6833-ce05-42c3-ba86-bcd2f6557183 req-7e8ac922-50f3-49e9-b4c2-e1a16f3c5c9a service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 1098 time: 0.1085503 May 26 14:54:55.004271 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7c9475a3-0124-45d7-8e6e-0214d54b0d98 req-ebb66a94-4078-4120-b6d1-d204044ab444 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633776 May 26 14:54:55.007535 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-529c6833-ce05-42c3-ba86-bcd2f6557183 req-78ecbc41-fdec-42de-8c03-26409107046d service neutron] 10.222.0.79 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537355 May 26 14:54:55.883999 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:55.936850 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:56.206924 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b768ca-503e-4569-8db9-a571e64b3ee1 req-31c5ad41-a88a-46b8-a8c1-1e729e179ca2 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:56.208376 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d5b768ca-503e-4569-8db9-a571e64b3ee1 req-31c5ad41-a88a-46b8-a8c1-1e729e179ca2 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 945 time: 0.0930161 May 26 14:54:56.252871 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d5b768ca-503e-4569-8db9-a571e64b3ee1 req-e8cff742-a7ad-4e43-b6c3-3fdf0bfce795 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384843 May 26 14:54:57.463238 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32b22ae-326a-452f-b33b-97ec36209b82 req-81e7e88a-76c9-449d-b220-0316c667cfb7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:57.464649 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c32b22ae-326a-452f-b33b-97ec36209b82 req-81e7e88a-76c9-449d-b220-0316c667cfb7 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 945 time: 0.0868032 May 26 14:54:57.521806 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c32b22ae-326a-452f-b33b-97ec36209b82 req-b10639f5-7984-4806-9102-bc21647ee93e tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482645 May 26 14:54:57.527150 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:57.705657 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b46d11-2c10-433d-930e-ee755c325a19 req-3745e2cb-319f-44a2-a849-6b3dc0c23f1d tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:57.707142 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c4b46d11-2c10-433d-930e-ee755c325a19 req-3745e2cb-319f-44a2-a849-6b3dc0c23f1d tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 945 time: 0.0816312 May 26 14:54:57.751712 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c4b46d11-2c10-433d-930e-ee755c325a19 req-ed4141fb-6364-4642-ad05-2d87e9462f4f tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387185 May 26 14:54:57.775396 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49358) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:54:57.855643 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-916eebf0-31fe-4129-bd56-5327451b89bb tempest-TestVolumeBootPattern-73066992 tempest-TestVolumeBootPattern-73066992-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:54:57.857105 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-916eebf0-31fe-4129-bd56-5327451b89bb tempest-TestVolumeBootPattern-73066992 tempest-TestVolumeBootPattern-73066992-project-admin] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 1093 time: 0.0807421 May 26 14:54:57.860358 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49362) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:54:57.869045 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.v2.base [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Request body: {'floatingip': {'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'port_id': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address': '172.20.0.9'}} {{(pid=98445) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 26 14:54:57.878006 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 26 14:54:57.882242 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Usage tracker for resource:floatingip and tenant:054087186333487b82b9a7a12d02c80f is out of sync, need to count used quota {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 26 14:54:57.885402 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=98445) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 26 14:54:57.891517 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.quota.driver [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=98445) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 26 14:54:57.905521 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:58.049409 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:58.187444 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.db_base_plugin_common [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Allocated IP 172.27.3.7 (9026b71b-9440-4cf5-9621-fcfdac3440f9/6e5be695-73c1-4c55-ae2a-14b7ccca7abf/9ed14f26-27c7-469a-86a5-6e0c1fe95951) {{(pid=98445) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 26 14:54:58.337113 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:58.370149 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750109864924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:58.375814 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-55fc7077-5ab5-466f-b9d3-f87d6f9de66b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:58.442267 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Network 9026b71b-9440-4cf5-9621-fcfdac3440f9 is already hosted by enough agents. {{(pid=98445) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 26 14:54:58.445143 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.base_scheduler [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Resources bound (agent type, host, resource id): {{(pid=98445) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 26 14:54:58.449202 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Received port after_create {{(pid=98445) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 26 14:54:58.483217 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=9ed14f26-27c7-469a-86a5-6e0c1fe95951,revision_number=1']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:58.487431 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:58.971189 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:59.057009 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7757602'] for port, before_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:59.267574 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for port, precommit_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:59.274462 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750110298251', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750109864942', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750109863711', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2334270'] for port, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:59.278065 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-7d013b92-e5ed-4e27-86cc-c4f4840d383a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:54:59.382031 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event updated for resources: {'Port': ['ID=9ed14f26-27c7-469a-86a5-6e0c1fe95951,revision_number=2']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:54:59.386057 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:54:59.395176 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-418017'] for floatingip, after_update {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:54:59.569057 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.db.l3_db [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Floating IP 2fde5780-dc2a-461a-9ba4-4edc7d8977d9 associated. External IP: 172.27.3.7, port: b8a212cb-e171-4e5a-84df-897c59538b31. May 26 14:54:59.925958 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Router 39443462-555c-4ab6-8ab8-12514f6596b8 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98445) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:55:00.132160 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98445) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:55:00.141819 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:55:00.152276 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:55:00.152959 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:54:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:55:00.161800 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:00.226580 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 994 time: 2.3648245 May 26 14:55:00.227290 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:55:00.294872 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'status': 'completed', 'code': 200} May 26 14:55:00.346593 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:55:00.534799 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-74bd07a7-7d15-4eb0-8788-2f6528a7f512 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:00.536292 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-74bd07a7-7d15-4eb0-8788-2f6528a7f512 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 1098 time: 0.1951189 May 26 14:55:00.665171 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-92de9332-f024-4215-be5a-71607a1009af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:00.666692 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-92de9332-f024-4215-be5a-71607a1009af service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1239438 May 26 14:55:00.697722 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:58Z', 'revision_number': 1, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}, {'id': '2fde5780-dc2a-461a-9ba4-4edc7d8977d9', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.7', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:7c:d2:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:54:58Z', 'updated_at': '2021-05-26T14:54:58Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:55:00.701793 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:55:00.710647 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:55:00.711251 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:54:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:55:00.771028 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-bcf65623-1401-44b7-ba66-ad803c907ad9 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b8a212cb-e171-4e5a-84df-897c59538b31 HTTP/1.1" status: 200 len: 997 time: 0.0976346 May 26 14:55:00.835145 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-60d20aba-fd0a-44be-ab46-7a9cd27620fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:00.836561 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-60d20aba-fd0a-44be-ab46-7a9cd27620fd service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0571096 May 26 14:55:00.888073 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:55:00.912508 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-d0fdbf4f-c717-4d18-a327-6956c5120d85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:00.914060 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-d0fdbf4f-c717-4d18-a327-6956c5120d85 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0704696 May 26 14:55:01.048075 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-f78a289d-5cd3-499f-8fa7-ad03066b5b18 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263888 May 26 14:55:01.182247 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1a7f1bda-0d00-4bb0-b959-a0984e79831a req-c5298fd5-0319-4059-bd5a-ea115063adee service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273293 May 26 14:55:01.244525 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:58Z', 'revision_number': 1, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}, {'id': '2fde5780-dc2a-461a-9ba4-4edc7d8977d9', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.7', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:7c:d2:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:54:58Z', 'updated_at': '2021-05-26T14:54:58Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:55:01.248697 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8f59ca0-a5bb-4b78-88fa-b717b941c774 None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:58Z', 'revision_number': 1, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}, {'id': '2fde5780-dc2a-461a-9ba4-4edc7d8977d9', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.7', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:7c:d2:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:54:58Z', 'updated_at': '2021-05-26T14:54:58Z', 'revision_number': 0, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:55:01.433480 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a16bc32f-eca9-448d-a18b-436d4e0b3ffc None None] New status for floating IP 2fde5780-dc2a-461a-9ba4-4edc7d8977d9: ACTIVE {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:55:02.280767 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-e2ff1e85-f8d1-4f55-9c47-a630b5e1fd6b service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0843580 May 26 14:55:02.448483 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-9c1d82a7-7ba8-46f4-81aa-c57055db40f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:02.449893 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-9c1d82a7-7ba8-46f4-81aa-c57055db40f0 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1099 time: 0.0805168 May 26 14:55:02.603035 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-efd2f628-b922-4bc2-a1ac-1ca279e429d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:02.604563 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-efd2f628-b922-4bc2-a1ac-1ca279e429d1 service neutron] 10.222.0.79 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 911 time: 0.1283965 May 26 14:55:02.713829 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-6f50d72d-c72a-4c6b-9c92-aefdef79c6cf service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 1002 time: 0.0980453 May 26 14:55:02.778722 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-5895c878-2436-4b33-9dcc-53f5cfb7e540 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:02.780082 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-5895c878-2436-4b33-9dcc-53f5cfb7e540 service neutron] 10.222.0.79 "GET /v2.0/subnets?id=acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 200 len: 848 time: 0.0579667 May 26 14:55:02.859689 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-f86e72e0-c1f9-4c48-b410-a60e4a718c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:02.861118 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-f86e72e0-c1f9-4c48-b410-a60e4a718c06 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0743067 May 26 14:55:03.000577 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-21ddaf1f-03ff-4409-88f6-1c69470706f2 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266670 May 26 14:55:03.133768 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-a874d4b8-c213-47b8-ab3c-7de00330f906 req-68a9d435-6666-485e-ad3e-c6ef04aebddf service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258738 May 26 14:55:19.248893 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:55:21.662586 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-00f4413d-def9-4e39-b58c-3ed747317292 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:23.301548 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5c6d5355-3b3f-41e0-922f-6e43d777e4f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:24.588041 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:25.890508 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:25.938017 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:27.530022 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:51.658621 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f83d68de-a72e-4132-a074-f1dd7e2bbcc7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:52.561697 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49392) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:55:52.839507 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Deleting port 48c8ea20-ebe6-430c-947f-51af8474ddbb {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:55:52.839753 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:52.960954 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:52.961283 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:53.082034 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Calling delete_port for 48c8ea20-ebe6-430c-947f-51af8474ddbb owned by network:floatingip {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:55:53.218126 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:53.221812 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4866f2c0-d3d3-4c7f-9b04-297009fb1ad7 tempest-AttachVolumeTestJSON-508415213 tempest-AttachVolumeTestJSON-508415213-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:55:53.265272 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event deleted for resources: {'Port': ['ID=48c8ea20-ebe6-430c-947f-51af8474ddbb,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:55:53.295516 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-de7dc841-5ba1-457d-a6c3-cccf3589b21d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:53.337309 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.337681 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.338044 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.338424 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.338778 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.339132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.339476 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.339825 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.340171 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.340515 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.340843 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.341180 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:53.344511 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:55:53.380132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for floatingip, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:53.380463 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Floating IP 663ac210-fd9a-476f-a587-2f1a057e92bd disassociated (deleted). External IP: 172.27.3.163, port: 75cc186e-5074-4469-92d5-751dfabe82ec. May 26 14:55:53.866813 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Router 4a536108-40a6-42ed-a3fe-5ad5763534db has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:55:54.054885 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:55:54.064420 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] Sync routers for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:55:54.069116 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:54.074764 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:55:54.075378 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:55:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:55:54.126930 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "DELETE /v2.0/floatingips/663ac210-fd9a-476f-a587-2f1a057e92bd HTTP/1.1" status: 204 len: 168 time: 1.5639021 May 26 14:55:54.127523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:55:54.286635 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec', 'status': 'completed', 'code': 200} May 26 14:55:54.312423 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:55:54.412890 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-180c5a25-08e0-4b05-8fdd-f1c00dbff48a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:54.414627 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-180c5a25-08e0-4b05-8fdd-f1c00dbff48a service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 1099 time: 0.0764809 May 26 14:55:54.614220 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:54.646574 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:30Z', 'revision_number': 5, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:55:54.650801 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] Checking router: 4a536108-40a6-42ed-a3fe-5ad5763534db for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:55:54.659384 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:55:54.659998 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:55:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:55:54.724397 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4171d78-9fd8-4e5a-86f9-12fae54ee44f req-3ca12e27-ca3c-453b-b593-9ebd071f1a55 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:54.725735 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e4171d78-9fd8-4e5a-86f9-12fae54ee44f req-3ca12e27-ca3c-453b-b593-9ebd071f1a55 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.2836831 May 26 14:55:54.726884 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-e3bfd055-b1f6-44c3-9d9a-0b74bddf2e4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:54.728198 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-e3bfd055-b1f6-44c3-9d9a-0b74bddf2e4c service neutron] 10.222.0.79 "GET /v2.0/networks?id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 200 len: 911 time: 0.3061121 May 26 14:55:54.811969 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-7ea08c0f-966d-418a-8a3f-51f5414ef78b service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 200 len: 217 time: 0.0672486 May 26 14:55:54.839969 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:55:54.866886 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-e4171d78-9fd8-4e5a-86f9-12fae54ee44f req-0dca2aed-286c-46ee-b588-e90112e0dc85 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1349282 May 26 14:55:54.890753 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-6451def9-646c-44e6-a65e-f09fd8e8889a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:54.892335 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-6451def9-646c-44e6-a65e-f09fd8e8889a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 200 len: 848 time: 0.0721958 May 26 14:55:54.973940 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-5c95a453-f6d4-4575-909f-ba3da865ebb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:54.975443 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-5c95a453-f6d4-4575-909f-ba3da865ebb2 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=4950f4fb-5f1e-4749-92f0-4580bd8b7f80&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0761957 May 26 14:55:55.109472 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-2623aab8-e9d8-4b60-b245-01e8375fb7f2 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1252122 May 26 14:55:55.172661 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:30Z', 'revision_number': 5, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:55:55.176783 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e85fd2e-6445-4c36-be85-44f3809993cf None None] The sync data for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi is: [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:25Z', 'revision_number': 4, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': 'f89ba2e3-b9cb-4e0e-bc3e-527426130f29', 'name': '', 'network_id': '4950f4fb-5f1e-4749-92f0-4580bd8b7f80', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'mac_address': 'fa:16:3e:bb:b8:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_interface', 'standard_attr_id': 612, 'fixed_ips': [{'subnet_id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:24Z', 'updated_at': '2021-05-26T14:51:30Z', 'revision_number': 5, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'subnets': [{'id': 'acf544a2-b701-4da7-82b8-dbc54487e21b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:55:55.245925 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1eee202e-4d28-4610-ae40-15d81a0527a2 req-e3474125-f79a-475f-a3c5-511fcdef1a95 service neutron] 10.222.0.79 "GET /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1301100 May 26 14:55:55.393616 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-899c4e22-fba3-4084-8679-30fab40fbb19 None None] New status for floating IP 663ac210-fd9a-476f-a587-2f1a057e92bd: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:55:55.923243 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:55.940580 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:56.082178 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be17c2f2-44ea-4b4d-a364-b1bbd512de71 req-3e25a0a0-33aa-4480-97ce-4e01b19d7cf1 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:56.083614 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-be17c2f2-44ea-4b4d-a364-b1bbd512de71 req-3e25a0a0-33aa-4480-97ce-4e01b19d7cf1 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.0927505 May 26 14:55:56.173067 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-be17c2f2-44ea-4b4d-a364-b1bbd512de71 req-325fdfd4-80e3-41ad-99c6-a7e771f638f9 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/security-groups?id=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609388 May 26 14:55:56.198177 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-72ed3f91-ce7e-4b36-8749-930a26ab3311 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:55:56.199626 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-72ed3f91-ce7e-4b36-8749-930a26ab3311 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.79 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 946 time: 0.1253092 May 26 14:55:56.247546 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:55:56.338179 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Deleting port 75cc186e-5074-4469-92d5-751dfabe82ec {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:55:56.338562 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:56.471590 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] For port 75cc186e-5074-4469-92d5-751dfabe82ec, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=75cc186e-5074-4469-92d5-751dfabe82ec,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:55:56.471823 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:56.597695 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Calling delete_port for 75cc186e-5074-4469-92d5-751dfabe82ec owned by compute:nova {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:55:56.712817 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:56.720714 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-ed7a7f20-ec44-445c-a34e-d373e3cd62f2 tempest-AttachVolumeNegativeTest-1903767310 tempest-AttachVolumeNegativeTest-1903767310-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:55:56.767201 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event deleted for resources: {'Port': ['ID=75cc186e-5074-4469-92d5-751dfabe82ec,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:55:56.804069 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.804466 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.804791 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.805168 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.805519 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.805874 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.806216 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.806588 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.806932 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.807277 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.807615 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.807933 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98445) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:55:56.815162 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:55:56.859867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] No DVR routers for this DVR port 75cc186e-5074-4469-92d5-751dfabe82ec on host hv-cinder-77459 {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:55:56.863247 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:56.865810 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'name': 'network-vif-deleted', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:55:56.874007 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-c12a9fb6-b901-4996-a33c-02e84c86473a req-a662b1ba-52e4-44d8-9228-b5ed3f0d7e3c tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.79 "DELETE /v2.0/ports/75cc186e-5074-4469-92d5-751dfabe82ec HTTP/1.1" status: 204 len: 173 time: 0.6680498 May 26 14:55:56.919162 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c6969e6b-47e0-47f6-b86b-d6eb353c9c51', 'name': 'network-vif-deleted', 'tag': '75cc186e-5074-4469-92d5-751dfabe82ec', 'status': 'completed', 'code': 200} May 26 14:55:57.328633 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-5518849b-856a-4da1-bcdf-d6d06e0ee9e9 req-601d1172-d187-4849-a753-37fa22f464f8 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Synchronizing usage tracker for tenant:28b9778de23c484bb66e4ac1f5aeb2c5 on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:55:57.348003 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-5518849b-856a-4da1-bcdf-d6d06e0ee9e9 req-601d1172-d187-4849-a753-37fa22f464f8 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Unset dirty status for tenant:28b9778de23c484bb66e4ac1f5aeb2c5 on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:55:57.349494 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-5518849b-856a-4da1-bcdf-d6d06e0ee9e9 req-601d1172-d187-4849-a753-37fa22f464f8 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "GET /v2.0/ports?device_id=c6969e6b-47e0-47f6-b86b-d6eb353c9c51 HTTP/1.1" status: 200 len: 210 time: 0.0667582 May 26 14:55:57.529939 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:58.455080 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49412) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:55:58.545378 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-641f1009-f381-4715-bd61-5a7491a81dfb tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:58.582547 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-641f1009-f381-4715-bd61-5a7491a81dfb tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:58.659388 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-641f1009-f381-4715-bd61-5a7491a81dfb tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:58.668111 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-778b62e1-eacb-44bd-be26-a80511ba67f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:55:58.684417 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-641f1009-f381-4715-bd61-5a7491a81dfb tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:55:58.687661 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-641f1009-f381-4715-bd61-5a7491a81dfb tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:55:58.693953 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-641f1009-f381-4715-bd61-5a7491a81dfb tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:58.695124 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-641f1009-f381-4715-bd61-5a7491a81dfb tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] 10.222.0.72 "DELETE /v2.0/security-groups/10fec8b8-dcc7-4b9f-b363-2591ef2cf4d3 HTTP/1.1" status: 204 len: 168 time: 0.2389150 May 26 14:55:58.740308 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49418) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:55:59.306844 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:59.830959 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Deleting port f89ba2e3-b9cb-4e0e-bc3e-527426130f29 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:55:59.831694 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:55:59.953089 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] For port f89ba2e3-b9cb-4e0e-bc3e-527426130f29, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:55:59.953392 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:00.077380 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Calling delete_port for f89ba2e3-b9cb-4e0e-bc3e-527426130f29 owned by network:router_interface {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:00.352280 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:00.355948 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a1a5eaa2-4176-4c78-a1b5-226df744ea7a tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:00.401902 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Pushing event deleted for resources: {'Port': ['ID=f89ba2e3-b9cb-4e0e-bc3e-527426130f29,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:00.405035 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:00.573586 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 75cc186e-5074-4469-92d5-751dfabe82ec no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:00.608618 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 75cc186e-5074-4469-92d5-751dfabe82ec {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:00.609153 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 75cc186e-5074-4469-92d5-751dfabe82ec not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:00.670861 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:01.031453 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Router 4a536108-40a6-42ed-a3fe-5ad5763534db has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:56:01.323957 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:56:01.333078 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] Sync routers for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:56:01.341985 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-bd759d41-387f-40f8-8ddb-93b4bd9e6304 admin admin] 10.222.0.72 "PUT /v2.0/routers/4a536108-40a6-42ed-a3fe-5ad5763534db/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6005580 May 26 14:56:01.343978 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:01.344617 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49422) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:01.344758 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:55:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:01.516882 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks [] for router, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:01.522233 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:01.689153 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:01.762959 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Deleting port a8f4a817-f312-4eac-a9c1-20e18933f65a {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:01.763319 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:01.856562 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228'}], 'enable_snat': True}, 'gw_port_id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:56:00Z', 'revision_number': 5, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port': {'id': 'a8f4a817-f312-4eac-a9c1-20e18933f65a', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:c3:f2:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 611, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:51:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:01.860584 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] Checking router: 4a536108-40a6-42ed-a3fe-5ad5763534db for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:56:01.869704 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] Routers {'4a536108-40a6-42ed-a3fe-5ad5763534db'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:01.870471 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:55:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['4a536108-40a6-42ed-a3fe-5ad5763534db'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:01.886100 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] For port a8f4a817-f312-4eac-a9c1-20e18933f65a, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a8f4a817-f312-4eac-a9c1-20e18933f65a,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:01.886535 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.006989 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Calling delete_port for a8f4a817-f312-4eac-a9c1-20e18933f65a owned by network:router_gateway {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:02.019729 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] Set router 4a536108-40a6-42ed-a3fe-5ad5763534db gateway port host: None {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:02.126676 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:56:01Z', 'revision_number': 6, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:02.130554 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4575d35-ed63-42e0-a521-759c8fb379c7 None None] The sync data for ids ['4a536108-40a6-42ed-a3fe-5ad5763534db'] in dv-cinder-774594-6-iscsi is: [{'id': '4a536108-40a6-42ed-a3fe-5ad5763534db', 'name': 'tempest-TestShelveInstance-1170764644-router', 'tenant_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:21Z', 'updated_at': '2021-05-26T14:56:01Z', 'revision_number': 6, 'project_id': '28b9778de23c484bb66e4ac1f5aeb2c5', 'gw_port_host': None}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:56:02.156464 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.161556 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cdc-f5a3-47e6-977a-f7b98fce4d40 tempest-TestShelveInstance-1556675675 tempest-TestShelveInstance-1556675675-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:02.205638 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Pushing event deleted for resources: {'Port': ['ID=a8f4a817-f312-4eac-a9c1-20e18933f65a,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:02.208579 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:02.300786 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.475840 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.478185 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.503562 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.504248 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4a536108-40a6-42ed-a3fe-5ad5763534db {{(pid=98444) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:56:02.518777 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.522373 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] 10.222.0.72 "DELETE /v2.0/routers/4a536108-40a6-42ed-a3fe-5ad5763534db HTTP/1.1" status: 204 len: 168 time: 1.1744459 May 26 14:56:02.522612 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49426) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:02.583235 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] Deleting subnet acf544a2-b701-4da7-82b8-dbc54487e21b {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:56:02.586250 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.750101 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.837856 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:02.931630 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device f89ba2e3-b9cb-4e0e-bc3e-527426130f29 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:02.965919 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: f89ba2e3-b9cb-4e0e-bc3e-527426130f29 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:02.966275 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device f89ba2e3-b9cb-4e0e-bc3e-527426130f29 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:03.097805 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.102158 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-a2a465ea-b484-4796-810c-922476e58857 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:03.138844 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=acf544a2-b701-4da7-82b8-dbc54487e21b,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:03.141000 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.145025 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:03.146657 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-275608a0-0570-4267-b5dd-457dcf472a17 None None] Network 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:56:03.150489 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49430) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:03.151020 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-1266563c-378c-48ff-8cd8-2a15d9481499 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/acf544a2-b701-4da7-82b8-dbc54487e21b HTTP/1.1" status: 204 len: 168 time: 0.6269026 May 26 14:56:03.366027 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.413149 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] DHCP port deletion for 4950f4fb-5f1e-4749-92f0-4580bd8b7f80 request from dv-cinder-774594-6-iscsi {{(pid=98446) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 26 14:56:03.443094 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Deleting port 4ed33cd7-673c-4518-b4cf-e0f776a833fb {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:03.443435 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.485185 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Deleting port 4ed33cd7-673c-4518-b4cf-e0f776a833fb {{(pid=98446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:03.485566 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.582622 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] For port 4ed33cd7-673c-4518-b4cf-e0f776a833fb, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=4ed33cd7-673c-4518-b4cf-e0f776a833fb,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:03.583005 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.589443 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] For port 4ed33cd7-673c-4518-b4cf-e0f776a833fb, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=4ed33cd7-673c-4518-b4cf-e0f776a833fb,segment=NetworkSegment(c4a96841-5ad1-4e7d-bd36-df760e1caf70),segment_id=c4a96841-5ad1-4e7d-bd36-df760e1caf70)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:03.589800 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.704712 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Calling delete_port for 4ed33cd7-673c-4518-b4cf-e0f776a833fb owned by network:dhcp {{(pid=98446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:03.716573 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Calling delete_port for 4ed33cd7-673c-4518-b4cf-e0f776a833fb owned by network:dhcp {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:03.733941 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-c2afcc7e-db34-47a2-9764-20abefe9486e service neutron] 10.222.0.79 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2759128 May 26 14:56:03.752103 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933'] for port, after_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.760971 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:03.797622 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] No DVR routers for this DVR port 4ed33cd7-673c-4518-b4cf-e0f776a833fb on host dv-cinder-774594-6-iscsi {{(pid=98446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:03.806055 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Pushing event deleted for resources: {'Port': ['ID=4ed33cd7-673c-4518-b4cf-e0f776a833fb,revision_number=None']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:03.811146 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:03.814278 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e3ec9224-fd20-44c7-bb57-23cc62348395 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:03.818870 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.819213 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.819545 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.819874 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.820235 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.821009 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.821436 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.821864 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.822183 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.822524 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.822840 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.823152 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98446) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:03.826330 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-bf623822-f60a-4335-a696-84b358f04fb4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:03.867299 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] No DVR routers for this DVR port 4ed33cd7-673c-4518-b4cf-e0f776a833fb on host dv-cinder-774594-6-iscsi {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:03.869021 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Pushing event deleted for resources: {'Port': ['ID=4ed33cd7-673c-4518-b4cf-e0f776a833fb,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:03.898262 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:03.991606 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:04.005973 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4950f4fb-5f1e-4749-92f0-4580bd8b7f80']}} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:04.019757 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c4a96841-5ad1-4e7d-bd36-df760e1caf70') {'for_net_delete': True} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:04.020050 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.services.segments.db [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c4a96841-5ad1-4e7d-bd36-df760e1caf70') {} {{(pid=98445) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:04.027652 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-59c4c4ee-79f6-4115-b2b9-83ce88e1c5a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:04.029161 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-59c4c4ee-79f6-4115-b2b9-83ce88e1c5a8 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 1099 time: 0.2618351 May 26 14:56:04.035030 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2677883'] for segment, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:04.052839 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:04.089790 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Releasing vlan 1145 on physical network physnet1 to pool {{(pid=98445) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:56:04.090106 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2334298'] for segment, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: util.warn( May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: util.warn( May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: util.warn( May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: util.warn( May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: Traceback (most recent call last): May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: timer() May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: cb(*args, **kw) May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: return func(*args, **kwargs) May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: self._notify() May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: self.callback(batched_events) May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: event.method(event) May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: return f(self, *a, **k) May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._get(url).json() May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: return self.request(url, 'GET', **kwargs) May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:56:04.103762 dv-cinder-774594-6-iscsi neutron-server[98445]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:56:04.238473 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:04.258254 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-9b20452d-80ae-472f-b2fb-d8cfffb0e081 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:04.272979 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:04.291327 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Pushing event deleted for resources: {'Network': ['ID=4950f4fb-5f1e-4749-92f0-4580bd8b7f80,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:04.298166 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:04.300669 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-0a3ff6f9-80cb-4d4d-b62a-a680e56827b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:04.302119 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-0a3ff6f9-80cb-4d4d-b62a-a680e56827b2 service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.2517157 May 26 14:56:04.365762 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] 10.222.0.72 "DELETE /v2.0/networks/4950f4fb-5f1e-4749-92f0-4580bd8b7f80 HTTP/1.1" status: 204 len: 168 time: 1.2112787 May 26 14:56:04.366100 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49434) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:04.407159 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-b5d7ed10-2ecd-4893-8538-340ee86892ee service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=57a32134-be1e-490a-ac2e-088e73027408 HTTP/1.1" status: 200 len: 1002 time: 0.0978343 May 26 14:56:04.477999 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-c6a03130-ab87-4a2c-863d-010dbd04f08b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:04.479475 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-c6a03130-ab87-4a2c-863d-010dbd04f08b service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0664368 May 26 14:56:04.566293 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-af442cd6-4b5e-4747-8ec3-d3dcfee5b29a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:04.567788 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-af442cd6-4b5e-4747-8ec3-d3dcfee5b29a service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0817881 May 26 14:56:04.601643 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a8f4a817-f312-4eac-a9c1-20e18933f65a no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:04.635512 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: a8f4a817-f312-4eac-a9c1-20e18933f65a {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:04.635888 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a8f4a817-f312-4eac-a9c1-20e18933f65a not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:04.636283 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 4ed33cd7-673c-4518-b4cf-e0f776a833fb no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:04.669650 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 4ed33cd7-673c-4518-b4cf-e0f776a833fb {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:04.670117 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 4ed33cd7-673c-4518-b4cf-e0f776a833fb not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:04.709625 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-c4858197-0efd-4068-9b5f-223a08a11c0b service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1353049 May 26 14:56:04.943413 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-26aac2ac-1ccf-40d1-97da-42ecaef62c96 req-c1ad7153-9507-4275-b614-0eba6e9ea74c service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2274137 May 26 14:56:04.943640 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:05.380181 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Deleting port f7927c93-7c71-4890-bf98-14084da6ec98 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:05.380907 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:05.608657 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] For port f7927c93-7c71-4890-bf98-14084da6ec98, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=f7927c93-7c71-4890-bf98-14084da6ec98,segment=NetworkSegment(b8e926a3-ea56-493c-bb6a-a41b3652bb24),segment_id=b8e926a3-ea56-493c-bb6a-a41b3652bb24)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:05.609019 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:05.729351 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Calling delete_port for f7927c93-7c71-4890-bf98-14084da6ec98 owned by network:router_interface {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:05.905703 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:05.909434 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:05.952455 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Pushing event deleted for resources: {'Port': ['ID=f7927c93-7c71-4890-bf98-14084da6ec98,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:05.955618 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:06.230557 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:06.619044 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Router 08aad9f4-39ef-41df-a92c-f8a161593b8b has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:56:06.797904 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:56:06.807869 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] Sync routers for ids ['08aad9f4-39ef-41df-a92c-f8a161593b8b'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:56:06.816880 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-27681302-7fa9-473a-b962-79f684c52627 admin admin] 10.222.0.72 "PUT /v2.0/routers/08aad9f4-39ef-41df-a92c-f8a161593b8b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4494681 May 26 14:56:06.818788 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] Routers {'08aad9f4-39ef-41df-a92c-f8a161593b8b'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:06.819405 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:55:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['08aad9f4-39ef-41df-a92c-f8a161593b8b'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:06.819642 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49438) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:06.998042 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] Set router 08aad9f4-39ef-41df-a92c-f8a161593b8b gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:07.118548 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks [] for router, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:07.295613 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:07.312258 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201'}], 'enable_snat': True}, 'gw_port_id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:56:05Z', 'revision_number': 5, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port': {'id': '5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:10:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 633, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:51:29Z', 'updated_at': '2021-05-26T14:51:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:07.316464 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] Checking router: 08aad9f4-39ef-41df-a92c-f8a161593b8b for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:56:07.325607 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] Routers {'08aad9f4-39ef-41df-a92c-f8a161593b8b'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:07.326202 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:55:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['08aad9f4-39ef-41df-a92c-f8a161593b8b'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:07.367304 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Deleting port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:07.367633 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:07.477759 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] Set router 08aad9f4-39ef-41df-a92c-f8a161593b8b gateway port host: None {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:07.491307 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] For port 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:07.491661 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:07.581239 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:56:07Z', 'revision_number': 6, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:07.585437 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b77163e2-ff48-4ddb-a82a-4cf9e97344c4 None None] The sync data for ids ['08aad9f4-39ef-41df-a92c-f8a161593b8b'] in dv-cinder-774594-6-iscsi is: [{'id': '08aad9f4-39ef-41df-a92c-f8a161593b8b', 'name': 'tempest-TestShelveInstance-903443205-router', 'tenant_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:51:28Z', 'updated_at': '2021-05-26T14:56:07Z', 'revision_number': 6, 'project_id': '78915a8765bc4d5cb1781cbe6eebe45d', 'gw_port_host': None}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:56:07.612916 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Calling delete_port for 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f owned by network:router_gateway {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:07.760701 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:07.764423 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e4650e98-ede0-4cbb-be2f-09a263af0afc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:07.806957 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Pushing event deleted for resources: {'Port': ['ID=5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:07.810024 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:07.904457 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.083174 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.085424 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.111259 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.111759 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 08aad9f4-39ef-41df-a92c-f8a161593b8b {{(pid=98444) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:56:08.125977 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.127117 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] 10.222.0.72 "DELETE /v2.0/routers/08aad9f4-39ef-41df-a92c-f8a161593b8b HTTP/1.1" status: 204 len: 168 time: 1.3065333 May 26 14:56:08.129758 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49442) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:08.189673 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] Deleting subnet a62bd878-2032-417d-a192-a8107571412e {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:56:08.193058 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.243571 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.325494 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.594359 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:08.631972 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:08.632232 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 5b1f5151-aeb5-4bc6-ac42-3a6bc36cf16f not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:08.632617 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device f7927c93-7c71-4890-bf98-14084da6ec98 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:08.665429 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: f7927c93-7c71-4890-bf98-14084da6ec98 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:08.665745 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device f7927c93-7c71-4890-bf98-14084da6ec98 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:08.696757 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.701866 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:08.734104 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a62bd878-2032-417d-a192-a8107571412e,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:08.738501 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:08.740820 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.747169 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54fafa85-0627-4bad-8fda-0d633f7fd4fe None None] Network 03f468fb-31b1-4cd2-9057-202c8933354e requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:56:08.749259 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-486c4e82-8d44-4762-95f6-ea2d642f283b admin admin] 10.222.0.72 "DELETE /v2.0/subnets/a62bd878-2032-417d-a192-a8107571412e HTTP/1.1" status: 204 len: 168 time: 0.6184545 May 26 14:56:08.752023 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49446) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:08.865529 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.936753 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Deleting port 8f18d374-788d-4f05-b422-816c9581e5e0 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:08.937184 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:08.998442 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] DHCP port deletion for 03f468fb-31b1-4cd2-9057-202c8933354e request from dv-cinder-774594-6-iscsi {{(pid=98446) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 26 14:56:09.038297 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] For port 8f18d374-788d-4f05-b422-816c9581e5e0, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=8f18d374-788d-4f05-b422-816c9581e5e0,segment=NetworkSegment(b8e926a3-ea56-493c-bb6a-a41b3652bb24),segment_id=b8e926a3-ea56-493c-bb6a-a41b3652bb24)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:09.038800 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.104773 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] Deleting port 8f18d374-788d-4f05-b422-816c9581e5e0 {{(pid=98446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:09.105334 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.167400 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Calling delete_port for 8f18d374-788d-4f05-b422-816c9581e5e0 owned by network:dhcp {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:09.206282 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] For port 8f18d374-788d-4f05-b422-816c9581e5e0, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=8f18d374-788d-4f05-b422-816c9581e5e0,segment=NetworkSegment(b8e926a3-ea56-493c-bb6a-a41b3652bb24),segment_id=b8e926a3-ea56-493c-bb6a-a41b3652bb24)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:09.206620 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.218025 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.221947 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-332a37d5-a164-4e4f-bf6e-98cca2199db5 tempest-VolumesActionsTest-1734208165 tempest-VolumesActionsTest-1734208165-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:09.264503 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Pushing event deleted for resources: {'Port': ['ID=8f18d374-788d-4f05-b422-816c9581e5e0,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:09.267625 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:09.268481 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] No DVR routers for this DVR port 8f18d374-788d-4f05-b422-816c9581e5e0 on host dv-cinder-774594-6-iscsi {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:09.326881 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] Calling delete_port for 8f18d374-788d-4f05-b422-816c9581e5e0 owned by network:dhcp {{(pid=98446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:09.368801 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933'] for port, after_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.372376 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-b555fb30-afcb-4c79-9ef3-61453a465d02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:09.383371 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.396165 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['03f468fb-31b1-4cd2-9057-202c8933354e']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:09.408245 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b8e926a3-ea56-493c-bb6a-a41b3652bb24') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:09.408526 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b8e926a3-ea56-493c-bb6a-a41b3652bb24') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:09.417293 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] Pushing event deleted for resources: {'Port': ['ID=8f18d374-788d-4f05-b422-816c9581e5e0,revision_number=None']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:09.419851 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.420371 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:09.421461 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc9a2c4f-7ff6-4e57-9e1d-055d0a62d81d None None] No DVR routers for this DVR port 8f18d374-788d-4f05-b422-816c9581e5e0 on host dv-cinder-774594-6-iscsi {{(pid=98446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:09.438936 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.445162 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Releasing vlan 1126 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:56:09.445927 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:56:09.459301 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:56:09.537058 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.541108 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:09.553986 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.564199 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Pushing event deleted for resources: {'Network': ['ID=03f468fb-31b1-4cd2-9057-202c8933354e,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:09.568284 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:09.572285 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] 10.222.0.72 "DELETE /v2.0/networks/03f468fb-31b1-4cd2-9057-202c8933354e HTTP/1.1" status: 204 len: 168 time: 0.8192999 May 26 14:56:09.851200 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49452) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:09.901624 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-90ea8dd7-9506-4ee3-ab95-90564090c910 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=28b9778de23c484bb66e4ac1f5aeb2c5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0491624 May 26 14:56:09.904222 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49456) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:09.967290 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e69189cd-1e49-4ad9-9791-a2331bff59e1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:09.993214 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e69189cd-1e49-4ad9-9791-a2331bff59e1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:10.051821 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e69189cd-1e49-4ad9-9791-a2331bff59e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:10.055507 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-40781cab-902f-488b-b366-f70c683b7a6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:10.069273 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e69189cd-1e49-4ad9-9791-a2331bff59e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2ad0c76-6d6b-4351-9889-0cc71f824d9f,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:10.073128 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e69189cd-1e49-4ad9-9791-a2331bff59e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:10.076556 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-e69189cd-1e49-4ad9-9791-a2331bff59e1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:10.077697 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-e69189cd-1e49-4ad9-9791-a2331bff59e1 admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/b2ad0c76-6d6b-4351-9889-0cc71f824d9f HTTP/1.1" status: 204 len: 168 time: 0.1724353 May 26 14:56:10.444688 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49464) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:10.498441 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-6e5d8f4f-6001-493a-8c47-e1c7acf15574 admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=78915a8765bc4d5cb1781cbe6eebe45d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0523949 May 26 14:56:10.500898 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49468) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:10.572372 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d8b0406c-5f90-4fdd-8f4d-d04341a5728f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:10.589314 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 8f18d374-788d-4f05-b422-816c9581e5e0 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:10.602195 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d8b0406c-5f90-4fdd-8f4d-d04341a5728f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:10.626990 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 8f18d374-788d-4f05-b422-816c9581e5e0 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:10.627354 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 8f18d374-788d-4f05-b422-816c9581e5e0 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:10.656642 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d8b0406c-5f90-4fdd-8f4d-d04341a5728f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:10.660442 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-66b30664-220a-4fee-b6c5-af4607e89fa1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:10.672608 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b0406c-5f90-4fdd-8f4d-d04341a5728f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34e59287-f75d-4a68-9233-b4d1b23805f3,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:10.676163 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-d8b0406c-5f90-4fdd-8f4d-d04341a5728f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:10.679292 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-d8b0406c-5f90-4fdd-8f4d-d04341a5728f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:10.680479 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-d8b0406c-5f90-4fdd-8f4d-d04341a5728f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/34e59287-f75d-4a68-9233-b4d1b23805f3 HTTP/1.1" status: 204 len: 168 time: 0.1785634 May 26 14:56:21.663295 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-638e39e0-ba95-498d-a706-574ca1d85fc8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:23.309768 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a8878f42-7a7e-4e4f-9f7b-2297fbd72d7e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:24.582886 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:25.918180 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:25.943111 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:27.544750 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:29.176038 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49474) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:29.449216 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Deleting port 9ed14f26-27c7-469a-86a5-6e0c1fe95951 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:29.449475 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:29.570831 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:29.571132 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:29.793153 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Calling delete_port for 9ed14f26-27c7-469a-86a5-6e0c1fe95951 owned by network:floatingip {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:29.929552 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:29.933205 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-21c754eb-f68e-4a76-a8ef-3e53909c73ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:29.978976 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event deleted for resources: {'Port': ['ID=9ed14f26-27c7-469a-86a5-6e0c1fe95951,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:29.982262 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:30.083253 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:30.083499 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Floating IP 2fde5780-dc2a-461a-9ba4-4edc7d8977d9 disassociated (deleted). External IP: 172.27.3.7, port: b8a212cb-e171-4e5a-84df-897c59538b31. May 26 14:56:30.446795 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Router 39443462-555c-4ab6-8ab8-12514f6596b8 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:56:30.626049 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:56:30.636913 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:56:30.647499 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:30.648116 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:56:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:30.649589 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:30.709982 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "DELETE /v2.0/floatingips/2fde5780-dc2a-461a-9ba4-4edc7d8977d9 HTTP/1.1" status: 204 len: 168 time: 1.5298023 May 26 14:56:30.709982 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:56:30.752226 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'status': 'completed', 'code': 200} May 26 14:56:30.828706 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:30.870791 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-aa065644-180d-4a31-981a-1a986e9e6a9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:30.873133 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-aa065644-180d-4a31-981a-1a986e9e6a9a service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 1098 time: 0.0753071 May 26 14:56:31.008084 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-865f305e-4874-46e1-a468-14b54becde0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:31.009554 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-865f305e-4874-46e1-a468-14b54becde0b service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1305602 May 26 14:56:31.117655 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-b75980e3-b05e-4077-ac01-3bba4f3f54d2 service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b8a212cb-e171-4e5a-84df-897c59538b31 HTTP/1.1" status: 200 len: 217 time: 0.0728590 May 26 14:56:31.195095 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-f6fb30ad-ff65-401d-8fb0-b259b6dddd1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:31.196887 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-f6fb30ad-ff65-401d-8fb0-b259b6dddd1a service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0704308 May 26 14:56:31.197041 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:58Z', 'revision_number': 1, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:31.201114 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:56:31.210154 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:31.210795 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:56:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:31.211267 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52d4c917-9f18-43a1-ba07-31dfc5e45d34 req-8172e9db-7c5e-470c-93c0-7ac28ee823f5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:31.212749 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52d4c917-9f18-43a1-ba07-31dfc5e45d34 req-8172e9db-7c5e-470c-93c0-7ac28ee823f5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 945 time: 0.1989105 May 26 14:56:31.303995 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-52d4c917-9f18-43a1-ba07-31dfc5e45d34 req-97e13518-ed04-4217-8f25-f3bc788f0c2a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0611317 May 26 14:56:31.326142 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-3f9e4426-b5d1-4774-9819-892b596a9665 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:31.326142 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-3f9e4426-b5d1-4774-9819-892b596a9665 service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1085048 May 26 14:56:31.433199 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:31.457751 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-194cbd81-4507-447e-9076-51de7621a7ec service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277261 May 26 14:56:31.591502 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-7bca8e54-2e17-48e5-9591-cc07787cbf94 req-5c0b4412-1e00-4fdd-a7ee-d4bb7f6e53e5 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266763 May 26 14:56:31.785981 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:58Z', 'revision_number': 1, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:31.790488 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c395426b-af6c-4001-a6d2-c341b31ccd8a None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_floatingips': [{'id': '11a536c8-69e6-40f6-a848-0b1b08e8f14f', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'floating_ip_address': '172.27.3.209', 'floating_network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'router_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'port_id': '57a32134-be1e-490a-ac2e-088e73027408', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'mac_address': 'fa:16:3e:66:16:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:52:55Z', 'updated_at': '2021-05-26T14:52:58Z', 'revision_number': 1, 'project_id': '054087186333487b82b9a7a12d02c80f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:56:32.179155 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cfd1333-e56a-4938-9b34-054c60b2d29b None None] New status for floating IP 2fde5780-dc2a-461a-9ba4-4edc7d8977d9: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:56:32.499410 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9e495e-7682-4baf-b3d5-01db5a7bd499 req-6271ed74-591d-45ee-a5de-3fb74ffdbde5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:32.500925 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a9e495e-7682-4baf-b3d5-01db5a7bd499 req-6271ed74-591d-45ee-a5de-3fb74ffdbde5 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 945 time: 0.0895948 May 26 14:56:32.550068 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-9a9e495e-7682-4baf-b3d5-01db5a7bd499 req-b0e39430-00a8-4292-a828-8784625ee82f tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431120 May 26 14:56:32.696724 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-f5d84f97-02d8-41ea-80a6-3893579097c3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:32.698146 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-f5d84f97-02d8-41ea-80a6-3893579097c3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 945 time: 0.0948305 May 26 14:56:32.852559 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Deleting port b8a212cb-e171-4e5a-84df-897c59538b31 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:32.852833 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:32.985979 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] For port b8a212cb-e171-4e5a-84df-897c59538b31, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=b8a212cb-e171-4e5a-84df-897c59538b31,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:32.986295 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:33.197803 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Calling delete_port for b8a212cb-e171-4e5a-84df-897c59538b31 owned by compute:nova {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:33.247608 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:56:33.310202 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:33.316095 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-e1c76e39-2e1b-4c0c-ab68-e6922312e1ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:33.363652 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event deleted for resources: {'Port': ['ID=b8a212cb-e171-4e5a-84df-897c59538b31,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:33.366690 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:33.436032 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] No DVR routers for this DVR port b8a212cb-e171-4e5a-84df-897c59538b31 on host hv-cinder-77459 {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:33.438477 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:33.441013 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'name': 'network-vif-deleted', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:56:33.453729 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-fb741e58-4796-48b9-9b3e-b15f72c67583 req-914ac0ac-b0ad-4525-a3c6-72e008918f55 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "DELETE /v2.0/ports/b8a212cb-e171-4e5a-84df-897c59538b31 HTTP/1.1" status: 204 len: 173 time: 0.7496245 May 26 14:56:33.493935 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '341f30a6-21d7-49f7-a28e-f0bb8a1336a2', 'name': 'network-vif-deleted', 'tag': 'b8a212cb-e171-4e5a-84df-897c59538b31', 'status': 'completed', 'code': 200} May 26 14:56:33.706804 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-b5446ee5-5bf9-470b-8403-b0a8e7ffbbe6 req-798e7277-b95b-46c3-bfba-e9e4c5060447 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Synchronizing usage tracker for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:56:33.725495 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-b5446ee5-5bf9-470b-8403-b0a8e7ffbbe6 req-798e7277-b95b-46c3-bfba-e9e4c5060447 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Unset dirty status for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:56:33.726723 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b5446ee5-5bf9-470b-8403-b0a8e7ffbbe6 req-798e7277-b95b-46c3-bfba-e9e4c5060447 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=341f30a6-21d7-49f7-a28e-f0bb8a1336a2 HTTP/1.1" status: 200 len: 210 time: 0.0679700 May 26 14:56:36.744754 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device b8a212cb-e171-4e5a-84df-897c59538b31 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:36.789103 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: b8a212cb-e171-4e5a-84df-897c59538b31 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:36.789460 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device b8a212cb-e171-4e5a-84df-897c59538b31 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:37.266565 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49506) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:37.537486 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Deleting port 08abca8e-4afd-41a5-be49-1971c05a316d {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:37.537794 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:37.667464 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:37.667746 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:37.885694 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Calling delete_port for 08abca8e-4afd-41a5-be49-1971c05a316d owned by network:floatingip {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:38.012568 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:38.018268 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-5a5bb058-a279-4a87-9857-ff943eaaef7a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:38.064362 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event deleted for resources: {'Port': ['ID=08abca8e-4afd-41a5-be49-1971c05a316d,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:38.067495 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:38.155411 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:38.155667 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.db.l3_db [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Floating IP 11a536c8-69e6-40f6-a848-0b1b08e8f14f disassociated (deleted). External IP: 172.27.3.209, port: 57a32134-be1e-490a-ac2e-088e73027408. May 26 14:56:38.515971 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Router 39443462-555c-4ab6-8ab8-12514f6596b8 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:56:38.705574 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:56:38.715523 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:56:38.725221 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:38.725923 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:56:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:38.729713 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:38.788083 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8fafd083-4e02-4e20-a3d6-9b620b0900ee tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "DELETE /v2.0/floatingips/11a536c8-69e6-40f6-a848-0b1b08e8f14f HTTP/1.1" status: 204 len: 168 time: 1.5197482 May 26 14:56:38.788650 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'tag': '57a32134-be1e-490a-ac2e-088e73027408'}] {{(pid=98444) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:56:38.833165 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'tag': '57a32134-be1e-490a-ac2e-088e73027408', 'status': 'completed', 'code': 200} May 26 14:56:38.905225 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:38.950888 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-f48f9621-b903-4eeb-92ca-2f3ad01f76a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:38.952480 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-f48f9621-b903-4eeb-92ca-2f3ad01f76a5 service neutron] 10.222.0.79 "GET /v2.0/ports?tenant_id=054087186333487b82b9a7a12d02c80f&device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 1099 time: 0.0745459 May 26 14:56:39.127706 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-6a62cdc8-88d4-4d5a-bafe-b637d4a86243 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:39.129038 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-6a62cdc8-88d4-4d5a-bafe-b637d4a86243 service neutron] 10.222.0.79 "GET /v2.0/networks?id=0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 200 len: 913 time: 0.1705003 May 26 14:56:39.208133 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-e846de88-1914-4bf9-ae2d-2f5017549c0a service neutron] 10.222.0.79 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=57a32134-be1e-490a-ac2e-088e73027408 HTTP/1.1" status: 200 len: 217 time: 0.0706902 May 26 14:56:39.222095 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:39.226263 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:56:39.235610 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:39.236242 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:56:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:39.286343 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b22de612-d758-42ee-af98-97242a26218b req-b024dbfb-ff56-44e0-8911-cef5d458ce98 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:39.287864 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b22de612-d758-42ee-af98-97242a26218b req-b024dbfb-ff56-44e0-8911-cef5d458ce98 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 946 time: 0.2017641 May 26 14:56:39.291709 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-9c782ba9-41ab-439c-a706-09ef386dd42e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:39.293023 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-9c782ba9-41ab-439c-a706-09ef386dd42e service neutron] 10.222.0.79 "GET /v2.0/subnets?id=be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 200 len: 850 time: 0.0767014 May 26 14:56:39.379779 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-b22de612-d758-42ee-af98-97242a26218b req-faa895fc-ec01-4bfc-b2f3-fa658c40cfbf tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0855963 May 26 14:56:39.400527 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-9c509312-c141-40c2-982f-9dd92bf7a14b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:39.401980 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-9c509312-c141-40c2-982f-9dd92bf7a14b service neutron] 10.222.0.79 "GET /v2.0/ports?network_id=0a3b5429-9434-492a-ba57-3dfc671d164c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0947382 May 26 14:56:39.415856 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:39.533721 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-d61fab11-fb46-467b-b7a2-ac2505b66f28 service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1242220 May 26 14:56:39.667054 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1413b262-4cbd-41f4-a0fe-388135098f9d req-904070c0-dd5d-4967-8d14-ef05129b1c2a service neutron] 10.222.0.79 "GET /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266584 May 26 14:56:39.768047 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:39.772469 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d701fd4-3f8c-4a12-b74c-f389560ab1bd None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:49:35Z', 'revision_number': 4, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi', '_interfaces': [{'id': '2a366b9c-cef1-4539-9117-1fabfce12f8d', 'name': '', 'network_id': '0a3b5429-9434-492a-ba57-3dfc671d164c', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'mac_address': 'fa:16:3e:74:6b:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:35Z', 'updated_at': '2021-05-26T14:49:43Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'subnets': [{'id': 'be983207-7be6-448d-b3eb-3c77c2c0eda1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:56:39.985037 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f1e98f-787e-4539-a663-0cbe0ef9952c None None] New status for floating IP 11a536c8-69e6-40f6-a848-0b1b08e8f14f: DOWN {{(pid=98447) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 26 14:56:40.586623 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2cb57ce-61c4-435f-a37a-171c0af70e24 req-8f38f161-e932-498e-bdf6-069a132ed05a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:40.588098 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d2cb57ce-61c4-435f-a37a-171c0af70e24 req-8f38f161-e932-498e-bdf6-069a132ed05a tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 946 time: 0.0919147 May 26 14:56:40.638764 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-d2cb57ce-61c4-435f-a37a-171c0af70e24 req-4a461818-34c9-402a-b17b-e1533eab6a61 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/security-groups?id=ccbc02f3-8afe-463e-99ee-7fa02c671594&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416045 May 26 14:56:40.736361 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-f1018650-cfc9-4a3c-85f1-eafe52c9b217 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98445) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 26 14:56:40.737896 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-f1018650-cfc9-4a3c-85f1-eafe52c9b217 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 946 time: 0.0880268 May 26 14:56:40.875867 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Deleting port 57a32134-be1e-490a-ac2e-088e73027408 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:40.876183 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:41.115286 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.db [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] For port 57a32134-be1e-490a-ac2e-088e73027408, host hv-cinder-77459, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77459',level=0,port_id=57a32134-be1e-490a-ac2e-088e73027408,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98445) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:41.115588 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:41.237769 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Calling delete_port for 57a32134-be1e-490a-ac2e-088e73027408 owned by compute:nova {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:41.356138 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:41.361960 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-20a94f28-71b6-433e-9795-1ff54161ccc6 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:41.406680 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event deleted for resources: {'Port': ['ID=57a32134-be1e-490a-ac2e-088e73027408,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:41.410144 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:41.485018 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.db.l3_dvrscheduler_db [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] No DVR routers for this DVR port 57a32134-be1e-490a-ac2e-088e73027408 on host hv-cinder-77459 {{(pid=98445) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:41.487893 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for port, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:41.490579 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'name': 'network-vif-deleted', 'tag': '57a32134-be1e-490a-ac2e-088e73027408'}] {{(pid=98445) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 26 14:56:41.502632 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-8254e3ae-33ad-4a92-86b6-cfe2b3aa6e46 req-b063c025-f4de-434c-8608-4b170c4b8c2c tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.79 "DELETE /v2.0/ports/57a32134-be1e-490a-ac2e-088e73027408 HTTP/1.1" status: 204 len: 173 time: 0.7592165 May 26 14:56:41.535876 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ccee42e3-1ebd-4602-ae02-ea6645c45be5', 'name': 'network-vif-deleted', 'tag': '57a32134-be1e-490a-ac2e-088e73027408', 'status': 'completed', 'code': 200} May 26 14:56:41.817632 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-1d82454c-3606-49be-a922-96c2146a86a6 req-fd6aa9d0-7931-4fef-9d7b-04119cc800f3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Synchronizing usage tracker for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 26 14:56:41.835787 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.quota.resource [req-1d82454c-3606-49be-a922-96c2146a86a6 req-fd6aa9d0-7931-4fef-9d7b-04119cc800f3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Unset dirty status for tenant:054087186333487b82b9a7a12d02c80f on resource:port {{(pid=98445) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 26 14:56:41.837834 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [req-1d82454c-3606-49be-a922-96c2146a86a6 req-fd6aa9d0-7931-4fef-9d7b-04119cc800f3 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "GET /v2.0/ports?device_id=ccee42e3-1ebd-4602-ae02-ea6645c45be5 HTTP/1.1" status: 200 len: 210 time: 0.0628498 May 26 14:56:42.968222 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49524) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:43.229041 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Deleting port 64852d40-bb25-4e97-9bb7-142e320cd8f9 {{(pid=98445) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:43.229349 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:43.375715 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:43.376249 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:43.557331 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.plugins.ml2.plugin [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Calling delete_port for 64852d40-bb25-4e97-9bb7-142e320cd8f9 owned by network:floatingip {{(pid=98445) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:43.687768 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2334217'] for port, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:43.692563 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-b6017aa8-e04e-44f2-a304-3daf3db5e8a1 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:43.744136 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event deleted for resources: {'Port': ['ID=64852d40-bb25-4e97-9bb7-142e320cd8f9,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:43.769646 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:43.842015 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for floatingip, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:43.861771 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-238848'] for floatingip, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:43.862998 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-bcc6d4b1-109a-4f96-b554-957c5c3580da tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "DELETE /v2.0/floatingips/379fb7bf-c0af-4316-b18b-c25404c58164 HTTP/1.1" status: 204 len: 168 time: 0.8935046 May 26 14:56:44.775492 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 57a32134-be1e-490a-ac2e-088e73027408 no longer exists at agent hyperv_hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:44.815210 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] No Port match for: 57a32134-be1e-490a-ac2e-088e73027408 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:44.815483 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Device 57a32134-be1e-490a-ac2e-088e73027408 not bound to the agent host hv-cinder-77459 {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:45.282121 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49538) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:45.362773 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3ad09328-2e40-4db0-bb08-ca0ca76a26bd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group, before_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:45.392541 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3ad09328-2e40-4db0-bb08-ca0ca76a26bd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:45.462316 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3ad09328-2e40-4db0-bb08-ca0ca76a26bd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:45.466149 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-0637db00-cb62-4a58-9628-b1bc68d924dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:45.482021 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad09328-2e40-4db0-bb08-ca0ca76a26bd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccbc02f3-8afe-463e-99ee-7fa02c671594,revision_number=None']} {{(pid=98445) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:45.484797 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG oslo_concurrency.lockutils [None req-3ad09328-2e40-4db0-bb08-ca0ca76a26bd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:45.492976 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron_lib.callbacks.manager [None req-3ad09328-2e40-4db0-bb08-ca0ca76a26bd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Notify callbacks [] for security_group, before_response {{(pid=98445) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:45.494133 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-3ad09328-2e40-4db0-bb08-ca0ca76a26bd tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] 10.222.0.72 "DELETE /v2.0/security-groups/ccbc02f3-8afe-463e-99ee-7fa02c671594 HTTP/1.1" status: 204 len: 168 time: 0.2108819 May 26 14:56:45.551383 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49544) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:46.501005 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:46.951864 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Deleting port 2a366b9c-cef1-4539-9117-1fabfce12f8d {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:46.952549 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:47.094962 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] For port 2a366b9c-cef1-4539-9117-1fabfce12f8d, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=2a366b9c-cef1-4539-9117-1fabfce12f8d,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:47.095391 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:47.237321 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Calling delete_port for 2a366b9c-cef1-4539-9117-1fabfce12f8d owned by network:router_interface {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:47.407742 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:47.413301 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-bf93ceea-fe42-4728-98e7-eb502f38262b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:47.460365 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Pushing event deleted for resources: {'Port': ['ID=2a366b9c-cef1-4539-9117-1fabfce12f8d,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:47.488208 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:47.729738 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:48.234109 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Router 39443462-555c-4ab6-8ab8-12514f6596b8 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:56:48.442899 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:56:48.452878 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] Sync routers for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:56:48.458316 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-d2a8de9d-c0ab-4c28-a4d8-879b14b68ca4 admin admin] 10.222.0.72 "PUT /v2.0/routers/39443462-555c-4ab6-8ab8-12514f6596b8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9057508 May 26 14:56:48.460821 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49550) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:48.464225 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:48.464877 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:56:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:48.646908 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks [] for router, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:48.649646 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:48.837562 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:48.917634 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Deleting port d48a16a1-caa7-4814-bc94-b3d0bb60dff0 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:48.918261 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:48.937174 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:56:47Z', 'revision_number': 5, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port': {'id': 'd48a16a1-caa7-4814-bc94-b3d0bb60dff0', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:be:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:32Z', 'updated_at': '2021-05-26T14:49:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:48.942297 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] Checking router: 39443462-555c-4ab6-8ab8-12514f6596b8 for host: dv-cinder-774594-6-iscsi {{(pid=98446) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:56:48.951373 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] Routers {'39443462-555c-4ab6-8ab8-12514f6596b8'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98446) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:48.951998 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:56:23Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['39443462-555c-4ab6-8ab8-12514f6596b8'], 'active': True} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:49.047789 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] For port d48a16a1-caa7-4814-bc94-b3d0bb60dff0, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=d48a16a1-caa7-4814-bc94-b3d0bb60dff0,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:49.048088 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:49.110402 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvr_db [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] Set router 39443462-555c-4ab6-8ab8-12514f6596b8 gateway port host: None {{(pid=98446) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:49.175967 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Calling delete_port for d48a16a1-caa7-4814-bc94-b3d0bb60dff0 owned by network:router_gateway {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:49.213983 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_hamode_db [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:56:48Z', 'revision_number': 6, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98446) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:49.218059 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae7602fa-0eab-421a-919d-136a9fe5dd7c None None] The sync data for ids ['39443462-555c-4ab6-8ab8-12514f6596b8'] in dv-cinder-774594-6-iscsi is: [{'id': '39443462-555c-4ab6-8ab8-12514f6596b8', 'name': 'tempest-TestVolumeBootPattern-842792017-router', 'tenant_id': '054087186333487b82b9a7a12d02c80f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:31Z', 'updated_at': '2021-05-26T14:56:48Z', 'revision_number': 6, 'project_id': '054087186333487b82b9a7a12d02c80f', 'gw_port_host': None}] {{(pid=98446) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:56:49.321041 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:49.324529 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0237bbf7-1737-426c-8f05-21402ed2ac30 tempest-TestVolumeBootPattern-396682452 tempest-TestVolumeBootPattern-396682452-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:49.368926 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Pushing event deleted for resources: {'Port': ['ID=d48a16a1-caa7-4814-bc94-b3d0bb60dff0,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:49.372094 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:49.462319 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:49.749828 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:49.752279 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:49.778625 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:49.779129 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 39443462-555c-4ab6-8ab8-12514f6596b8 {{(pid=98444) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:56:49.791464 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:49.792569 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-3c4d983d-9c4b-4ffc-affe-963575867755 admin admin] 10.222.0.72 "DELETE /v2.0/routers/39443462-555c-4ab6-8ab8-12514f6596b8 HTTP/1.1" status: 204 len: 168 time: 1.3306520 May 26 14:56:49.796214 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49562) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:49.856283 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] Deleting subnet be983207-7be6-448d-b3eb-3c77c2c0eda1 {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:56:49.859476 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:49.918595 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.008137 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.266857 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.270700 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-71cbcf32-eb42-4314-98b4-9eb8fd798c3d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:50.305338 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=be983207-7be6-448d-b3eb-3c77c2c0eda1,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:50.308766 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:50.309749 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.314983 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d45c44be-ce4e-41b8-a357-afa301978ce7 None None] Network 0a3b5429-9434-492a-ba57-3dfc671d164c requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:56:50.318529 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-685e54a6-f1c4-4576-be20-c21d5273915e admin admin] 10.222.0.72 "DELETE /v2.0/subnets/be983207-7be6-448d-b3eb-3c77c2c0eda1 HTTP/1.1" status: 204 len: 168 time: 0.5189495 May 26 14:56:50.318941 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49566) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:50.433070 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.506684 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Deleting port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:50.506684 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.557402 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] DHCP port deletion for 0a3b5429-9434-492a-ba57-3dfc671d164c request from dv-cinder-774594-6-iscsi {{(pid=98446) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 26 14:56:50.610900 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] For port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:50.611304 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.624362 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 2a366b9c-cef1-4539-9117-1fabfce12f8d no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:50.660340 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] Deleting port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 {{(pid=98446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:50.660742 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.672369 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 2a366b9c-cef1-4539-9117-1fabfce12f8d {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:50.672687 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 2a366b9c-cef1-4539-9117-1fabfce12f8d not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:50.673100 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d48a16a1-caa7-4814-bc94-b3d0bb60dff0 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:50.733652 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Calling delete_port for e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 owned by network:dhcp {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:50.757534 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: d48a16a1-caa7-4814-bc94-b3d0bb60dff0 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:50.757842 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device d48a16a1-caa7-4814-bc94-b3d0bb60dff0 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:50.758280 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:50.785300 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.790239 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f987ce6e-f481-4349-adb8-6e2bf629ef62 tempest-TestMinimumBasicScenario-1920362667 tempest-TestMinimumBasicScenario-1920362667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:50.837596 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Pushing event deleted for resources: {'Port': ['ID=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:50.839527 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] No DVR routers for this DVR port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 on host dv-cinder-774594-6-iscsi {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:50.841069 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:50.851087 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:50.851441 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:50.873205 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] For port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,segment=NetworkSegment(38634d8d-479e-4c5f-9c7f-980524b5596f),segment_id=38634d8d-479e-4c5f-9c7f-980524b5596f)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:50.873702 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.957813 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:50.971018 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0a3b5429-9434-492a-ba57-3dfc671d164c']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:50.983190 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '38634d8d-479e-4c5f-9c7f-980524b5596f') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:50.983492 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '38634d8d-479e-4c5f-9c7f-980524b5596f') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:50.993770 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] Calling delete_port for e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 owned by network:dhcp {{(pid=98446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:50.995052 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:51.012966 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:51.019268 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Releasing vlan 1123 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:56:51.019666 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:56:51.033208 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:56:51.041853 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933'] for port, after_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:51.045480 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:51.087899 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] Pushing event deleted for resources: {'Port': ['ID=e0a1890e-a3d3-4e7d-8c41-5e1c9be36402,revision_number=None']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:51.092579 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:51.095203 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85f47d2e-10f5-4214-ba71-cc0e311178de None None] No DVR routers for this DVR port e0a1890e-a3d3-4e7d-8c41-5e1c9be36402 on host dv-cinder-774594-6-iscsi {{(pid=98446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:51.219791 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:51.223866 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2c9f2d79-786f-4087-955f-0df9aa345920 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:51.236581 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:51.247215 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Pushing event deleted for resources: {'Network': ['ID=0a3b5429-9434-492a-ba57-3dfc671d164c,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:51.250255 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:51.261925 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8adcfc39-6e2a-4cb3-8e61-5e1d9192dd2d admin admin] 10.222.0.72 "DELETE /v2.0/networks/0a3b5429-9434-492a-ba57-3dfc671d164c HTTP/1.1" status: 204 len: 168 time: 0.9420257 May 26 14:56:51.264798 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49570) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:51.662171 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1599fe38-f6f7-4cdb-a6a4-fbd073b0bb88 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:51.826837 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-421875'] for router_interface, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:52.254664 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Deleting port 917afd6f-9580-4821-871f-5de127fbbd50 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:52.255008 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:52.378725 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] For port 917afd6f-9580-4821-871f-5de127fbbd50, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=917afd6f-9580-4821-871f-5de127fbbd50,segment=NetworkSegment(786a8ec1-60bd-4f4e-b068-39f29884fb0e),segment_id=786a8ec1-60bd-4f4e-b068-39f29884fb0e)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:52.379079 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:52.501797 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Calling delete_port for 917afd6f-9580-4821-871f-5de127fbbd50 owned by network:router_interface {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:52.775747 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:52.779426 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2c7ae0a7-f72b-4909-9b48-f38885f449af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:52.828062 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Pushing event deleted for resources: {'Port': ['ID=917afd6f-9580-4821-871f-5de127fbbd50,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:52.831241 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:53.114576 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-575728', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-417347'] for router_interface, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:53.314132 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-881c8782-6cf7-4356-9aa0-0800778a64b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:53.493256 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 has already been hosted by L3 agent c2c473c4-a3b5-4ee4-826a-189299cba1ed {{(pid=98444) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 26 14:56:53.677934 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] Notify agent at l3_agent.dv-cinder-774594-6-iscsi the message routers_updated {{(pid=98444) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 26 14:56:53.686537 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] Sync routers for ids ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'] in dv-cinder-774594-6-iscsi {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 26 14:56:53.696340 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-f42a3898-ab67-4a1b-a24c-671f5862e028 admin admin] 10.222.0.72 "PUT /v2.0/routers/dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4304926 May 26 14:56:53.696594 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] Routers {'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:53.697149 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:56:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:53.699251 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49578) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:53.869747 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] Set router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 gateway port host: dv-cinder-774594-6-iscsi {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:53.876587 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks [] for router, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:54.055430 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:54.191035 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'external_fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236'}], 'enable_snat': True}, 'gw_port_id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:56:52Z', 'revision_number': 5, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port': {'id': '938c4ccb-8161-4ac5-914d-f09e83eca319', 'name': '', 'network_id': '9026b71b-9440-4cf5-9621-fcfdac3440f9', 'tenant_id': '', 'mac_address': 'fa:16:3e:19:52:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'ip_address': '172.27.3.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-774594-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:49:39Z', 'updated_at': '2021-05-26T14:49:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '6e5be695-73c1-4c55-ae2a-14b7ccca7abf', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-774594-6-iscsi'}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:54.196400 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] Checking router: dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 for host: dv-cinder-774594-6-iscsi {{(pid=98447) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 26 14:56:54.205808 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] Routers {'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'} bound to L3 agent in host dv-cinder-774594-6-iscsi {{(pid=98447) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 26 14:56:54.206462 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-774594-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-26T14:34:53Z,description=,heartbeat_timestamp=2021-05-26T14:56:53Z,host='dv-cinder-774594-6-iscsi',id=c2c473c4-a3b5-4ee4-826a-189299cba1ed,load=0,resource_versions=,resources_synced=,started_at=2021-05-26T14:34:53Z,topic='l3_agent')) {'router_ids': ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'], 'active': True} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:54.251504 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Deleting port 938c4ccb-8161-4ac5-914d-f09e83eca319 {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:54.251809 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:54.360036 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_dvr_db [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] Set router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 gateway port host: None {{(pid=98447) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 26 14:56:54.376396 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] For port 938c4ccb-8161-4ac5-914d-f09e83eca319, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=938c4ccb-8161-4ac5-914d-f09e83eca319,segment=NetworkSegment(de92d977-7df2-4448-8678-5399b2199f0b),segment_id=de92d977-7df2-4448-8678-5399b2199f0b)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:54.376743 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:54.467732 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.l3_hamode_db [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:56:54Z', 'revision_number': 6, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port_host': None}], 'dv-cinder-774594-6-iscsi', False) {} {{(pid=98447) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:54.472069 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5527b900-98b5-41b3-ba52-6fb8c5c8ee41 None None] The sync data for ids ['dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24'] in dv-cinder-774594-6-iscsi is: [{'id': 'dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24', 'name': 'tempest-TestVolumeBootPattern-909364918-router', 'tenant_id': '33d94aeb09de4d84a66010b7eea38bd5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:49:38Z', 'updated_at': '2021-05-26T14:56:54Z', 'revision_number': 6, 'project_id': '33d94aeb09de4d84a66010b7eea38bd5', 'gw_port_host': None}] {{(pid=98447) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 26 14:56:54.506107 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Calling delete_port for 938c4ccb-8161-4ac5-914d-f09e83eca319 owned by network:router_gateway {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:54.581713 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:54.673915 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:54.677811 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-e1db5e35-4cbf-4e50-87c4-737ae604d4a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:54.721826 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Pushing event deleted for resources: {'Port': ['ID=938c4ccb-8161-4ac5-914d-f09e83eca319,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:54.767609 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.767854 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.768248 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.768608 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.768935 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.769286 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.769634 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.769980 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.770350 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.770700 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.771047 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.771392 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-774594-6-iscsi {{(pid=98444) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 26 14:56:54.799303 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:54.831733 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-418012'] for router_gateway, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:54.896044 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 917afd6f-9580-4821-871f-5de127fbbd50 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:54.936572 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 917afd6f-9580-4821-871f-5de127fbbd50 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:54.936925 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 917afd6f-9580-4821-871f-5de127fbbd50 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:55.009452 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415811', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7896'] for router, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.012498 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.042270 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-416111'] for router, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.042783 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Fanout notify agent at l3_agent the message router_deleted on router dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 {{(pid=98444) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 26 14:56:55.057722 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] Notify callbacks [] for router, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.058893 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-1a069830-cc13-4aca-9874-e37c07ca5051 admin admin] 10.222.0.72 "DELETE /v2.0/routers/dbb4eaf5-936e-40d5-9cfb-64d14e4e5b24 HTTP/1.1" status: 204 len: 168 time: 1.3586712 May 26 14:56:55.061971 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49582) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:55.129369 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.db_base_plugin_v2 [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] Deleting subnet 1453c895-ac82-418c-b052-3278289fec92 {{(pid=98444) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 26 14:56:55.132884 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.183151 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3085664'] for subnet, precommit_delete_associations {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.266047 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7700222'] for subnet, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.525454 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7693097', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42906', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3085695', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3135763'] for subnet, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.529257 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-2516412d-50e1-4d02-93d7-6f64d91ef857 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:55.563166 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1453c895-ac82-418c-b052-3278289fec92,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:55.566211 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:55.567224 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.573910 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-9c96adb1-8cf5-4312-a0b7-debfeaa8f589 admin admin] 10.222.0.72 "DELETE /v2.0/subnets/1453c895-ac82-418c-b052-3278289fec92 HTTP/1.1" status: 204 len: 168 time: 0.5109122 May 26 14:56:55.574396 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24e1e252-4ada-4ad2-84d4-a126d60f8497 None None] Network 2f2b3312-ac79-425a-9a67-643b775d13ba requested from dv-cinder-774594-6-iscsi {{(pid=98446) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 26 14:56:55.576593 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49586) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:55.682697 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7852394'] for network, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.814663 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] DHCP port deletion for 2f2b3312-ac79-425a-9a67-643b775d13ba request from dv-cinder-774594-6-iscsi {{(pid=98446) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 26 14:56:55.862482 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Deleting port a181c14c-3176-4bdf-a575-c37a1e3de6db {{(pid=98444) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:55.862787 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.883923 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] Deleting port a181c14c-3176-4bdf-a575-c37a1e3de6db {{(pid=98446) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 26 14:56:55.884301 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750110295116'] for port, before_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.966503 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.db [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] For port a181c14c-3176-4bdf-a575-c37a1e3de6db, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a181c14c-3176-4bdf-a575-c37a1e3de6db,segment=NetworkSegment(786a8ec1-60bd-4f4e-b068-39f29884fb0e),segment_id=786a8ec1-60bd-4f4e-b068-39f29884fb0e)] {{(pid=98444) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:55.966841 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.995851 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:55.998385 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.003220 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.db [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] For port a181c14c-3176-4bdf-a575-c37a1e3de6db, host dv-cinder-774594-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-774594-6-iscsi',level=0,port_id=a181c14c-3176-4bdf-a575-c37a1e3de6db,segment=NetworkSegment(786a8ec1-60bd-4f4e-b068-39f29884fb0e),segment_id=786a8ec1-60bd-4f4e-b068-39f29884fb0e)] {{(pid=98446) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 26 14:56:56.003600 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-419584'] for port, precommit_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.091057 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.plugin [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Calling delete_port for a181c14c-3176-4bdf-a575-c37a1e3de6db owned by network:dhcp {{(pid=98444) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:56.125246 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] Calling delete_port for a181c14c-3176-4bdf-a575-c37a1e3de6db owned by network:dhcp {{(pid=98446) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 26 14:56:56.139505 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3085198'] for port, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.144776 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-7caf7996-2b11-4ff6-a439-c58a34062529 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:56.173906 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7757303', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42817', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-575714', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750110298278', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750109864933'] for port, after_delete {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.177628 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-d69e5d74-dc01-42db-ab99-44525b610982 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:56.191527 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Pushing event deleted for resources: {'Port': ['ID=a181c14c-3176-4bdf-a575-c37a1e3de6db,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:56.194522 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:56.195670 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] No DVR routers for this DVR port a181c14c-3176-4bdf-a575-c37a1e3de6db on host dv-cinder-774594-6-iscsi {{(pid=98444) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:56.222815 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] Pushing event deleted for resources: {'Port': ['ID=a181c14c-3176-4bdf-a575-c37a1e3de6db,revision_number=None']} {{(pid=98446) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:56.225617 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG oslo_concurrency.lockutils [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:56.227891 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c23ef769-4e71-4722-acad-b65d7b99f68e None None] No DVR routers for this DVR port a181c14c-3176-4bdf-a575-c37a1e3de6db on host dv-cinder-774594-6-iscsi {{(pid=98446) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 26 14:56:56.310588 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7694435', 'neutron.services.segments.db._delete_segments_for_network-8750110310117'] for network, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.324156 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2f2b3312-ac79-425a-9a67-643b775d13ba']}} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:56.336741 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '786a8ec1-60bd-4f4e-b068-39f29884fb0e') {'for_net_delete': True} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:56.337039 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.services.segments.db [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '786a8ec1-60bd-4f4e-b068-39f29884fb0e') {} {{(pid=98444) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 26 14:56:56.349232 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750110317478', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3085657'] for segment, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.367677 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835'] for segment, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.374197 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Releasing vlan 1146 on physical network physnet1 to pool {{(pid=98444) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 26 14:56:56.374610 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7697835', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3085277'] for segment, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: Traceback (most recent call last): May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: timer() May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: cb(*args, **kw) May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: return func(*args, **kwargs) May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: self._notify() May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: self.callback(batched_events) May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: event.method(event) May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_id = self._get_aggregate_id(event.segment_id) May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: aggregate_uuid = self.p_client.list_aggregates( May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: return f(self, *a, **k) May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._get(url).json() May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: return self._client.get(url, endpoint_filter=self._ks_filter, May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: return self.request(url, 'GET', **kwargs) May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: base_url = self.get_endpoint(auth, allow=allow, May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: auth = self._auth_required(auth, 'determine endpoint URL') May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 26 14:56:56.388119 dv-cinder-774594-6-iscsi neutron-server[98444]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 26 14:56:56.469293 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7694460', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-506458', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-575723', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-418035'] for network, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.474279 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:56.492523 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-575692'] for network, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.502635 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Pushing event deleted for resources: {'Network': ['ID=2f2b3312-ac79-425a-9a67-643b775d13ba,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:56.506723 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:56.510783 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-3ddc966d-ea49-48a7-98e5-07bb3b731cbe admin admin] 10.222.0.72 "DELETE /v2.0/networks/2f2b3312-ac79-425a-9a67-643b775d13ba HTTP/1.1" status: 204 len: 168 time: 0.9332061 May 26 14:56:56.630940 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 938c4ccb-8161-4ac5-914d-f09e83eca319 no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:56.638767 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49592) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:56.687727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: 938c4ccb-8161-4ac5-914d-f09e83eca319 {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:56.688207 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device 938c4ccb-8161-4ac5-914d-f09e83eca319 not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:56.688795 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a181c14c-3176-4bdf-a575-c37a1e3de6db no longer exists at agent ovs-agent-dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 26 14:56:56.692625 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-8117415f-4561-44b6-96ef-3d1db811129d admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=054087186333487b82b9a7a12d02c80f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0504072 May 26 14:56:56.692945 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49596) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:56.746895 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.plugin [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] No Port match for: a181c14c-3176-4bdf-a575-c37a1e3de6db {{(pid=98446) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 26 14:56:56.747439 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron.plugins.ml2.rpc [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Device a181c14c-3176-4bdf-a575-c37a1e3de6db not bound to the agent host dv-cinder-774594-6-iscsi {{(pid=98446) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 26 14:56:56.753437 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d2fd7f-31d2-4966-a639-3252bf3ff8bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.780053 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d2fd7f-31d2-4966-a639-3252bf3ff8bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.834399 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d2fd7f-31d2-4966-a639-3252bf3ff8bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.838145 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-0eb35803-9da4-44cc-9bd0-fc8f2eeeb4ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:56.856231 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d2fd7f-31d2-4966-a639-3252bf3ff8bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14e5fd49-d455-4ac4-928f-ad6b0f0b99bb,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:56.859961 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-60d2fd7f-31d2-4966-a639-3252bf3ff8bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:56.863830 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-60d2fd7f-31d2-4966-a639-3252bf3ff8bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:56.865019 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-60d2fd7f-31d2-4966-a639-3252bf3ff8bb admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/14e5fd49-d455-4ac4-928f-ad6b0f0b99bb HTTP/1.1" status: 204 len: 168 time: 0.1709766 May 26 14:56:57.249522 dv-cinder-774594-6-iscsi neutron-server[98445]: DEBUG neutron.wsgi [-] (98445) accepted ('10.222.0.72', 49604) {{(pid=98445) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:57.302947 dv-cinder-774594-6-iscsi neutron-server[98445]: INFO neutron.wsgi [None req-feaca44b-1d9f-4f68-95c9-84e40ce9fb1f admin admin] 10.222.0.72 "GET /v2.0/security-groups?tenant_id=33d94aeb09de4d84a66010b7eea38bd5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0520747 May 26 14:56:57.305561 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [-] (98444) accepted ('10.222.0.72', 49608) {{(pid=98444) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 26 14:56:57.368114 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-43fca9b9-068c-40c6-94b2-b0123cacfc8f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:57.400607 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-43fca9b9-068c-40c6-94b2-b0123cacfc8f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:57.454747 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-43fca9b9-068c-40c6-94b2-b0123cacfc8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-506476'] for security_group, after_delete {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:57.458671 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-90e89238-4233-4895-b6d7-2b90ec8979f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:57.469582 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43fca9b9-068c-40c6-94b2-b0123cacfc8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e9ef5fb-3eca-4b02-867c-2a51b71294f6,revision_number=None']} {{(pid=98444) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 26 14:56:57.471994 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG oslo_concurrency.lockutils [None req-43fca9b9-068c-40c6-94b2-b0123cacfc8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=98444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:57.478841 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron_lib.callbacks.manager [None req-43fca9b9-068c-40c6-94b2-b0123cacfc8f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98444) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:56:57.479977 dv-cinder-774594-6-iscsi neutron-server[98444]: INFO neutron.wsgi [None req-43fca9b9-068c-40c6-94b2-b0123cacfc8f admin admin] 10.222.0.72 "DELETE /v2.0/security-groups/8e9ef5fb-3eca-4b02-867c-2a51b71294f6 HTTP/1.1" status: 204 len: 168 time: 0.1734147 May 26 14:56:57.539272 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:10.247246 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:57:21.662957 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-f2e4901b-1d72-4bac-aed1-52b58e060215 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:23.322586 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-510a79bf-a019-40b2-9039-7fa52743e8ae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:24.584952 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:25.928443 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:25.957627 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:27.544646 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:47.247232 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:57:51.661841 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c616970b-01fd-46e4-a576-7bdeb8c94dfa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:53.307559 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-e90c1425-6157-4489-91b1-e380f6a333da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:54.581224 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:55.942485 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:55.953285 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:57:57.547210 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:21.662424 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1d724c31-4ca3-4533-85e0-7ee169bb320f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:23.319947 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c66784df-7666-4fe1-807a-68195e2e5023 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:23.856500 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [req-79d03894-16dd-4492-8c4d-0fcae52fc43c req-fec8ca43-8b21-40c0-90cf-8116f215430e service neutron] (98444) timed out ('10.222.0.79', 56541) {{(pid=98444) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 26 14:58:24.253275 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:58:24.586221 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:25.965945 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:25.967028 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:27.555504 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:51.663545 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-4f5e5073-31ed-40b6-9169-cce7552cf845 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:53.317094 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-9bfb9722-e6e2-46cd-8a37-9593471e3e62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:54.592913 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:55.969267 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:55.972147 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:58:57.563733 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:01.257588 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:59:21.665345 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8ce94159-26a4-4500-95b3-56858604273f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:23.324601 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-657bc9e2-1940-4e3d-a8bd-227bbe5a3a59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:24.589731 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:25.981183 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:25.982282 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:27.566588 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:38.257310 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 14:59:51.665536 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-61654a9b-f27c-47eb-a297-66fd27b4dac1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:53.312825 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-6828267e-e367-43dd-aa62-055f7590fd0c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:54.576087 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:55.970898 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:55.974977 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 14:59:57.565212 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:15.257754 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 15:00:21.659375 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-df8a9444-ff17-4f51-a7cd-dbb39a3c8f37 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:23.309015 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-5e865282-74eb-487f-892b-76f339b5287a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:24.573868 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:25.970722 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:25.976723 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:27.581361 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:51.670245 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-7bb2c8ad-bffa-4387-891f-4905c3dcbefe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:52.257010 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 15:00:53.306177 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-72d9bb69-9792-4f18-bb37-dfef680d76eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:54.569828 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:55.992727 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:55.993821 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:00:57.594401 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:21.663835 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-10fee332-38bc-4130-b877-8b8e2176a6b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:22.462763 dv-cinder-774594-6-iscsi neutron-server[98444]: DEBUG neutron.wsgi [req-bdc8aba9-f4ad-4bfd-9633-5b6b985e9055 req-7286245e-1342-4905-b36c-5b5cd3a80551 service neutron] (98444) timed out ('10.222.0.79', 56569) {{(pid=98444) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 26 15:01:23.302415 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-45a89519-5255-4fab-a3aa-465be452b189 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:24.574652 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:25.986826 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:25.988365 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:27.575371 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:29.256516 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 26 15:01:51.667516 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-70803937-d141-47a2-a6c7-36e8041d939d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:53.301627 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-9d6fd8ef-6244-4177-82b8-808a22ccadb0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:54.579662 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-8699dca2-e200-49c0-a495-04a82e1ea0d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:55.992773 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-c947f671-3485-43f6-a64e-1ea51a38667b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:55.995022 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-a2e3809e-524a-4bd9-ba26-23fa4df6bbc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:01:57.579193 dv-cinder-774594-6-iscsi neutron-server[98446]: DEBUG neutron_lib.callbacks.manager [None req-1ec5206a-3c11-493f-965f-cbc1c7ce3e96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750110310135', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7672509'] for agent, after_update {{(pid=98446) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 26 15:02:06.261660 dv-cinder-774594-6-iscsi neutron-server[98447]: DEBUG neutron.db.agents_db [None req-5c6f6a95-f1da-4b9e-8151-3dfa5ded6439 None None] Agent healthcheck: found 6 active agents {{(pid=98447) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}